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ABSTRACT . 

A five-year study was uiidertaken to develop criterion 
rating scales fo;ir predicting successftfl performance In gradnate / 
Easiness study, as well as in later career progress. . The scales 
esi)odied .dlsenalonsr other than grades, which were judged by a> 
nationwide panjpl of faculty to be relevant to performance • The sc4les 
were defined ud anchored by specific ezasples of behavioral / ^ . 
incidents, ^ira were entitled; interest in sanageient Invplveient; 
■anagerial skill; ftelf development; perspective and breadth of 
knowledge; technical knowledge; critical awareness; problem analysis 
ability; resolution and decisiveness; planning for implementation; 
communication skJL^; enthusiasm; initiative; persistence «kd drive; 
flexibility; and consideration. / 



Mi-.'., ■ 

/PO W S«9 



iTITOrflON 
RBPORT HO 
POB DATS 
ROTE 

BDBS PRICE 
DESCRIPTORS 



■ ■ / 

/ 



i 1 




* R«prodiictions: iiuppli'edi ED^ that can be -sade ' * 

♦ ' froB the original docnseht. ♦ 



4 . 



RB-TO-3 



U I DiPJ^«TMlMTO<*HiAtTN. 
IOUCAtlON*Wll.^AKI 
NATIONAL INlTltUTI OP 
, IDUCATION ! t 




THIS OOCUMCNT HAS •ifN •i^Sj; 
OUCEO f KACTLV AS »iCr»ViO F»OM 
THt KSON OH OHOANIIATION 0»IOIN- 
io 'NiONI 

OP 



PERFORMANCE CRITERIA IN GRADUATE BUSINESS SftlDY: ^TT^i'oS^VT^%^i^W«;i^ 

Sf NT OFFICIAL MAtlONABjartlTO^i 
iOWC»T10M POSITION M^fOtKW 

PARTS I AND II— DEVELOPMENT OF RATING SCALES,-., ^ ' / 



BACKGROUND DATA FORM AND THE PILOT STUDY 



Thomas L. Hilton, Lome M. Kendall 
and Thomas B. Sprecher 



•■PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE 'educational RESOURCES 
INFORMATION CENTER (ERIC) AND 
USER»6f THE ERIC S'f'STEM.", , ; 



t"TT * . . -V'M^' 

^ts BuL],<ptln is a draf.t for Interoffice ct5P^MjjgJdn. 

fc 



Corrections and Suggestions for revision are solicited. 
The Bulletlh should not he cited as a reference- without 
the specific peimife^ion of the authors. It is automati- 
cally superseded upcin fonnal puhlicatton pf the material. 




Educational Testing Servicevft 



Princeton, New Jersey- 
January 1970 



• Performance 'Criteria in Graduate Business Study: 
Partsi, r and II"Develo|]ttient of Rating Scalea, 
' * Background Data pjpjrm and the Pilot Study 

■ ^ Thdoas L. Hilton Lome M. Kendall 
:V and Thomas Sprecher 



■ ■ W 

Abstraclt^ > « 

Is grsAje average alone a sufficient criterion of student attaitraent r \ * 
or shouli^ other student attributes he measured to supplement gi^Bkdas as ^. 
criterii, especially % selectlng^^l!^ : \'i 

A five-yeax study was undertaken in which criterion rating t^cales. 
were developed enibodying dlioensions, other than g^^ judged b^' fkcsiiill^ 
to be relevant to perfonnance in graduate study in business and tp;^ lateif /: 
career, progress. After extensive constiltation with a nationwide i^eXnO^^ ^» 
facufty neidbers^ 'the. scales were defined And anchored by specific dbcajnpil^s 
of behavioral incidents. In addition, a ccoiprehenslve biographical q^es-v - - 

tionnftire was prepared. ^ _ - # 

■ • . . V ■ 

A pilot study in two graduate business ^schools showed the techzilgue 

to be proolsing, although very demanding of ^tSie faculty, judges . The research 

• . « . • » ■ - 

staff 's experience In develofling the .scales is discussed, as well as the 

• . ' 

laqpllcations of the jpvocedxire . < ^ 7 
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This paper repoz^s the deirelopment of criterion measures embodying, 
ixiBotBir as posbible, the genex^dly agreed upon goals of graduate business 
education. Assuming that mastery of course content Is measured reasonably 
veil by current examining methods, criterion measures developed In the 



• . . . - - . 

course'^of this study vere aimed at <iualltles fcrund desirable by f^unilty 

loembers but not satisfactorily taken into acc6unt. by pre/sent grading pro- 

' ce^ures-^qualities' which sooaoetiines resu^-t in .tfae designation of a B student 

rather than an A stttdent as the ma^ most lilcQly to contribute significantly 

in later professional life. ^ ^ 

\ ^ ■ ■ 

A. broad array of criteria was sought as the first step tovrardB a more 
cooqprehensive basis for Judging the effectiveness of various materials and 
methods used^ in student selection. These selection aids (predictors) 
include previous academic performance, test sdbres, .and biograpk^ and 
background ^ta. Certainly students who obtain good 'grades are|wanted, but 

there IGoay veil be other characterlstlcis^ of eq>aal or' greater istpoortance to 

f » ■ 

later performance which are not adequately reflected in grades. If academic 
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grades^ as presently assigned, do not fully reflect the values which schools 
are tiylng to achieve, then the use of grewles alone as a criterion leads to 
quite inadequate and misleading evaluations. 

Most evidence indicates that aptitude and achievement meastires are the 
best predictors of academic grades and that the euidJ^tion of extra*academic 
m&asTires, such as biographical and background information, to the predictor 
battery produces only moderate increments in the accuracy with which grades 
can be predicted — probably not enoughs to Justify the added cost of usJLng 
the additional predictors. In a. study of high school students, Hilton and 
liyerL (I967), for expmple,, found that biographical information alone yielded 
a mufLtiple correlation with raa3jfc;^>4J^ class of * 57^ test scores alone yielded 
a multiple correlation of .66, and that biographical information added to 
test scores raised the multiple correlation to .72, These data give little 
suppjort for the use of ' biographicial data in selecting students who will ob- 
tain good grades. V 

* But biographical and other ^extra-academic information may be used in 
admissions work to indicate things other than academic performance in the 
na,rrow sense of grade-getting. Then the use of more comprehensive criteria 
is required and there is good reason to believe that in such cashes extra- 
academic data would coijttri^ute substantially to p^diction. The study involv* 
ing college undergraduarbes by Anastbsi, Meade^ and Schneiders (196O) supports 
this eacpectation. . 

ThuB^ coQDprehensive criteria should permit anndbe adequate evaluation 
of extr^-fltcademic information and contribute to the development of guidelines 
for the. use of these materials in admissions. In addition, there are Impar^ 
tant supplementary uses- fw an array of criterion measures. Of special 



inrportanpe la the place of grades within the context of the comprehensive 
criteria]; a description of grades in terms of several distinguishable cri- 
terion dianensions could prove informative. An array of criterion measxiras , 
could be tuBed diarectly for purposes of evaluation at -the completion of a 
program and could be used at several stages during the progress of a program 
to assess the growth resulting from the ^program. Finally^ assessments in 
terms of the criterion measwes applied during graduate training may provide 

a 

good leads as to likely subsequent performance on the ijob> an especiaJLly 
ln5)ortant consideration in* view of tha frequent finding that s\ach Neater per- 
fornance has negligible or only n^xiestltelatlor. ships tio academic perfonnanoe 
as measured by grades alone. 

f 

The present report deals with the devel^^nt and pilot testing of a 
number of criterion measures. 
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l4rt I: The Deve^USpinent <tf the Rating Scales ' ' 

I, ^ , Procedure 

Selection of Melj^ for Crlteri^^ Measureiaent 

SomA oeans pif raiting iflMi Judged to be the moat apparopriate way of obtala* 
Ing the required Information concerning the dimensions of greatest interest. 
The prcAlems inherent in rating (biases from leniency and halo, unreliability, 
and associated difficulties ) are, ho¥Cvei\^ coBmon kngw-edge. These prdblens 
arise from (a) axnbiguity or Indefinite specification in defining the cotttieot 
of a trait to be rated and in providing standards^by ^rtiich to Judge the level 
pf a trait, and (b) lack of specific, relevant information about the subject' . 
which can be Used ih arriving at a rating^ To alleviate these problems a 
method of rating was chdsenJtrtJicrffSras designed to force the attention of «ie. 
rater on behavioral incidents relevant to qxialities to be assessed. 

' Behaviorally anchored rating scales have a long history (Jaterson, 1925; 
Richardson & KMer, 1935). Hbe specific method used here was first d^loped 
by Smith and Kendall (;L965) for use in evaluatlhg several dimensions' of^ nurs- 
ing perf omknce . . Th^e sclOes were anchorisd by examples of expected behavior. 
Expecl^ttons based on having observed similar behavior were used to permit 
grating in a variety of situations wi|fioait sacrifice of specificity. I 

The method developed initially with nitrses has been generalised with 
good results to evaljiate student counsellors (Maas, I965) a»d reselrch . 
engineers (Sprec}ier, I965.). Maas cco^pared convent j^pnal graphic rating 
methods with Ibehaviorally 'anchored scales with the genez^ result that int^- 
ra£er reliabllil^ was xunially one and one^half to tyo times larger for the. 
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behavlorally anchoired icalls jinder ccnipar&ble conditions tmd for the sajne 
xample, aadian Inter -tnfcervliBfv correlations (with different 

_ n each interview) betwi^en overall sxaanMury evaluations was -Jlf 

for "ithe ti^aditlonaa^ method as compared with .55 fo^ihe behaviorally anchored » 

method, ^ • 

• *■ 

Sprecher, working with engineers, us€d factor ^analysis techniquea to 
demonBtrate that behaviorally anchored scales produced a nvunber of distin- 
gulshable and sonewhat independent dlinensions for eva:V'^tion. 

Connor and Talbot (196'f) used specific behavioral examples to aijchor 
rating sj^eiles to evaluate progress of young mentally retarded children 
exposed to an experimental curriculxon. 

Thire are four steps in the present method. First, qualit^|pl t^be 
evaluated are selected and genered. definitions constructed. : Then examples 
of Incidents intended to illustrate each quality are collected. These * 
Incidents are ^reallocated by independent Judges toietermine the extent df 
agreement as to the quality best illustrated by a given exanq^e. Finally, 
Judtgments are obtained as to the level bf a quality « illustrated by a given 

. ■ *. 

Determination of fauaJlties to Be Evaluated./ . )r * , 



>termj^tion of jp:uaill 



Opinion yas surveyed conc<emlng the qualities that should be assessed. 
TJds vas done partly through a siuvey of the literature, but primarily 
throui^ assesibllng a small group knowledgeable 'and Interested consultants 
^ fktn the^faculty at several business schools. Faculty |p^ultants and-( 
iOocational Testing Service personnel net for the purpose of developing 
* definitions and illustrations of qualities laoBt desired in the graduatej^ of 

V <^ ' ' o ^ 
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buBinesa schools. In order to establish some coninon ground as a point of 
• departure for the meeting, each partioipemt prior to the^meeting contributed 
a position paper defining sooid ot the ^quaLlities he regarded aji lin>ortant and 
outlined the rationale fo^ryfchelr selection, . 

Orer 100 qualities wepe j^oposed, but attention. vas restricted to those 
guallties that coul4 be illustrated with specific examples and thus night 
have a chance of being Inferred fro© concrete, observable behavior. Wisdomj 
for exanqple^was rejected bx|t initiative vas retained. The success of the 
me^od lies in constant attention to the linking of general qualities to 
specific illustratioris of behavior exhibiting those' quaiftiep . The investi- 
gators did tind, however, that in order to limit the qualities to a manage- 
a^^e manberT which at the saioe ti^ were reasonably comprehi^nsive, it was 
necessary to conbine some at^fcrlbutes into fairly global di2De^l6nS"iDore 
globaJ. than desir||tbie in tex4a of clear-cut definitions. Persistence and 
drive t for exait^ftiyH;^ combined in one scale. T5ie final list included 
IJ qualities* ''•^ ' ^ . ' » 

The^jposition papers ^^ubmitted by the consultants provided the background 
fron' which nuitterous illustrations, and, eventuially, final forms of rating . 
scales were developed. The papers, provided a general* definition of hi g h , 
medium, and low levels of each of a number of qii^ities . 

' ^ \ ■ 

Collection of Examples of Specific Behaviors in Each Quality 

J > • ' ' 

The faculty consultants provided at least one specific exanqple llluatrat* 

ing ee^ level of each quality to be considered. Wherever possible, e xa i npl es 

were Included from a variety of settings in order to emphasise the generality 

of a quality across different situations such as the classroom, seminars^ 
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nrltten, r«popt8> and face-to-face exchanges. Additional definitions and 
behavioral examples were supplied by ET8 personnel. A sempling of the 
examples is as follows: 

This student would prefer a puamer Job as a mansgement trainee to a 
higher-paying technical Job. ^ 

In case discussions this studient would not consider the social 
Impl^ations of suggested actions. 

Public relations aspects' of prbblpms would be considered irrelevant 
and might be Ignored by this student. 

This student seldom misses deadlines.^ 

This student would be at a loss if the- room he wis assigned for a 
discussion group was' locked. 

^ In all, 263 specific examples were collected and edited to appear in a 

comnon format. Party-two exsmples which duplicated or nearly duplicated 

others were eliminated. The surviving items are shown in Appendix A. "Each 

example was printed on a separate three by five card cuid packets of 50 

randcBly selected cards yere assembled for the next step, along with gen- 

eral definitions^ of each of the *15 potential qualities. 

Allocation of Examples to Qualities 

Faculty mentoers in 12 business^t^hools were asked to Judge what quality 



was illu^j|«ted by es^ example in one packet. Ibis procedure tested the 
validity of the orlgjSfti^l^^aaigjfiaent of an example to a particular quality. 
Eacamplea were elljninated if there was no clear agzjeement among the majority 
of Judges as to the quality it illustrated. Qualities were eliminated if 
ixaa^lMB wwre not consistently reassigned to the quaUty for which they were 
originally designed. This was the moat important step of the entire proce- 
dure since itr Insured that the retained examples provided unanblguoos 
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IJJUstrationB of a quality. In addition^ each quality became defined more 
concretely by the set of examples retained^ to illustrate it* A copy of the 
Judges* instructions is provided in Appendix B* 

A total of 62 Judges from the 12 schools returned data* On the average 
about 20 Judgments were bbtained for each example^ with the number of jud^* 
ments per qx&niple ranging from 10 to 27. The distribution of rallocations 
across qualities was obtained^ and the percentages of Judges assigning an 
exai&ple to the modal quality were computed • 



\ 

m * 

m 

Determinlftion. of the Level of a Quality Illustrated by Each Example 

In addition to allocating the examples he received to a particular 

0 

quality^ eatch Judge rated his examples as to level of the quality illustrated* 

The Judgment of level was m&de in relation to the general statements defining 

high J medium^ and low lervels of performance for the quality- An example of 

the forme used by the Judges is shown in Figure 1. An example of the lowest 

level of a quality might be s^signed a vjiue of 0*0^ the highest ilevel a 

value of 2.0^ and intermediate levels corresponding values between these 

extremes. The distribution of Judgments made by those assigning an example 

to the modal quality obtained^ as well as the mean scale value for each 

example. Examples were eliminated for which there was no clear agreement as 

to the.di^gree of a quality illustrated. ^ 

' From the survivors^ examples were chosen to illustrate different leirels 

of each scale > an effort being made to ''pin down'* the ends of eflu:h scale as 

well as several levels in between. As a final step^ a^j^l/of additional 

items was created to augment the selected exampJ^s where gaps were found in 

I 

the coverage of each scade. These supplementary items were screened with 
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3T faf^MAMAQEMENT INVOLVEMENT 



Bulc long-ranga goal ia to parti- 
olpate In mnagentnt . Comltted to 
aasiB&ing managerial raaponalbUlty. 



Ml^t aerve aa a ccoaultant on, 
problema of uMknagemant but prljaarlly 
Intereatad In teohnlqiue^^^d In 
studying aanaganiant aa a atai^ of 
avanta relevant to general reaearch 
Intereata. 



"^fcivltltf? 



Would engage In bualneaa 
only aa a neana to an end and llte3y 
vould/enter thia fle^ aa a aecond 
cholee. ^ 
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1.50 



1.25 



■> 1.00 



0.75 



0.50 



0.25 



0.00 
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figure 1. Bramplw of fons used in Jtidgljag level of 
qMallty illustrated. 



jghe assistance aC ?^ staff menfiers in the scooe vay the original pool vas ' 
BOxeei^ Tay ^he i|^lhess school fswtijty members ^ The end product of the 
four stages was a set of,"exaiiBples illtistratiBg different levels of perfor- 



nance for each of ^several qualities • « 

Resxats 



" Determination of Qualities " 

Scales were deyelopecL for 15 qualitieJs. ' Each of these qToal^ies is 

described briefly in Table 1. Even though soxne qualities were eliminated 

■ ■ 's 

for lack of stiff icient beha^lltoral examples, the authors feel* that these 

^ ' ' '■ ' , ' 

, qualities provide a reasonably comprehe^sive coverage of relevant dljnensions 
for evaluating performance of graduate students in business, although no 
claiia is made that this set of qualities is uniquely 6ost appropriate or 
cosnplete* It was generally agzreed, however, that most of these qualities* 
would be considered important in a number of schools. Also, examination of 
the sckies suggested that a number of other qualities rec omme nd^ for con- 
sideration 'were represented by various combinationsi of the present quaOities 
Although the scales generally represented desirmle qualities, the 

ixxvesljigators attempted to avoid value laden words - From the beginning of 

•■ •: ■ ' ^ ' ' ' ' - ■ ' . ■ . - ^- - - ■ ,^ , ■■ ■ ■ , • 

the project the assumption was made that each school which might, make use 

<^ the scales would review the list and '^decide for itself which qualities 

were most in keeping wi^' its educational, goals. Qnie school might decide, 

for example, that Technical Knowledge' is of key importance, while another 

inight eliminisite ±t trcm ^h^ 2^% . ^ ^ - . . 

A ''crude isub^Je^tive attaint, wis mad.^ t o^ place the 15 qualities within a 

general framework. ' >Me first two^ Se^ and Interest in 




. ^ \ T ■ Table 1 

Initial Qualities Descr^ive of ■ Perfcarmance for Gractuate Students in Business 

Goal Orientation 

1^ Self-Development (SD)— having cOearOy defined plans f or mddlflcatlcn 

BJoO. realization of long -texm goals. 
• 2. Interest in Ifanagement Involveiaent (M)— mbre inteiiest in management 
than in other areas. 

Resources , 

5. Perspective and Breadlda of Knowledge (eb)— alert to broad social, 
- political and ^.economic implications of de^ 

* Technical Knowledge (l^ttsbavlng technical facts and basic principles . 

, -- necessary to handle specific* "problems confined to business contact. 

5. Critical AvareAess (CA)— alert to environment cties and events, sensitive, 
■ ^ and insightful espepialJjr in regard to social reactions. Unbiased. 

Processing , ^ 

„ 6. I>roblem Analysis Ability (PA>-orderly, aiiaiytic exploration of problems 
and generation of alternatives, synthesis. 

Decision-maTd-Tig 

7. Resplution and Decisiveness (kd)— courage, self-confidence and 'pnstancy 

in the face of difficulty aad uncertain outcomes. Willingness to 
m^ke decisic^ns. • 

Execution ' ' 

8. Planning for Implementation (pi)--apprQpriate allocation and scheduling 

^ of resourdes and anticipation of cheuages in environment. 

9. Communication Skill (CS)~clarity and precision in both written and 

verbfiLL communication. 

JLO. Managerial Skill (MS)— able to delegate responsibility and get things 
^Qj^g^ ^j^^P^jglj others. ' - ' 

Styles v° "~ ' ' ' - 

11. Enthtisiasm (E)--reacts spontaneously, to peojae and problems. Respoiisive 

and vibrant. . ' " 

12. Initiative (l)— self-starter, active rather :than passive and reactive. 
15. Persistence .and Drive (ED ) —energetic and capable of prolonged attention 

to tasks. 

Ih. Flexibility (f)— receptive to neVr ideas, willing to change and to exper- 
iment. Inventive and adaptable. 
15. Consideration (c)— mindful and understanding of needs,, feelings, and 

'rights of others. - - 
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Management Invblvemint, were considered to repre|?ent fairly, general goat 
;', , orientations. " ' , " ^ ■ ■' . , '. ' •. 

The next three qiialities relate to rfesources avediable to the individ- 
ual, especiany his pr^ent kncfv^l^dge -and ability to obta^ 

of relevsiiice by being select^,vely attuned to the environment. 

: ^ . '•/ ■■ , . ; .• , *. . 

The next quality. Problem Analysis Ability, relates to the processing 

Of all r^levapt information in relation to goals and constraints in a given 

contest/ Resolution, and Decisiveness deals "^th decision -making and empha- 

/• • ■ , ■ ■ ■ ■ .■ . • ■ 

sizes willingness to make decisi6ns. It was intended, to be independent of 

■- ■ \ ' . ■' . j . . 

piroblem analysis ability. In fact, it is not impossible for a fwrson to 
, show high resolution and decisiveness while making the wrong decision. 

The. next three qualities relate to effective implementation of decisidns. 
They involve planning, and coikiipnication skill is a major tool. The last 
five qualities were called styles and^represent characteristic ways of per-, 
forming which could cut across any of the ixreceding qualities. To a large 
extent these stylistic qualities represent general personality and motiva- 
tional traits. 

The intended distinctibn between two of tl^e stylistic qualities needs 
ccrament. Initiative and ^self-reliance .are, ch^ self- 
stai^ter^ the person who finds tasks for hini^^^ and pursues them without 
^ prodding from others. Persistence and driVe represent a quality which It^ 
. is important |o distinguish from initiativ^. It is not difficult to Imagine^ 
instances of persistence in' the absence of initiative. The genejral defini- . 
tion fei* persistence and drive attempted to emphasize the breadth and gener- 
ality of persistence in contrast to very ijarrow and. compulsive behavior. 



■ The gdieral definitions tor each of the gualities (with the eixccption 
Of two vhich vere later i«ll«djmted) are shovm to. the boxes on th6 lefj'hand 
side, of , each of .the scales jpresented in Apjpfendix C.y The general definitions 
for Interest in Me&ageB»nt Involvement and Managerial Skill are presented in 
Appendix C follovdjog ■Uie oto • 

^ • ■ ■ ' ' ■ ■ ». f 

Examples of Specific Behaviors . . 'i 

The examples which were obtained from ,the. various sources are provided , 
for reference purposes in Appendix A. Those examples which were retained as 
anchors to illustrate particular levels of a quality can be seen on the 
right hapd side of tiae appropriate scale reprc«iuced in Appendix C One of 
scales. Initiative, is shown in Figure 2. . • 

A pervasive weatoess of the examples , was that they were too general, too 

ambiguous, and too limited in representativeness . Nevertheless, many. good 

■ ■ ' ■■ ■ ■'■ .' ' . ■ " ■ ■ ■ ' ■ '"■ 

exasKiles were found. ' ' , ~ 

Reallocation flttid Judgment of Level . r 

Table 2 shows the average agreement in modal assignment for, each quality 

■ im ■ 

separateily. The column olSe led* Initial Pool" ref^^ *o all of ^t*he items 

having a modal assignment tpi; & given quality and therefo^fe constituting the 

pool'of potential examples, to illustrate that quality. The column labeled 
■ i . '' - ' ■ » " 

"Retained Examples," refers to those examples selected as anchors for part ic- 

' ■■■ ■ - V .y^ ■ ■ " ■ , : ' V 

vOj^ scales. Judgments of the level illustrated by a given example i^ere 

tabulated and averaged for all those assigning the example to the modal ,qual- 

ity. In most instances there was good agreement iii the ;Judgment^of level; 

the' jtidgments usually clustered within three adjacent intervals of the,, scale. 
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'. 7oMtari]y takes -steps to accooiplisb 
tasks or solve problens vlthout intpe- 
bus fJcan other persqns. Able to lui- 
tidpate .ImineKv problems correctly 
' BDd toirork-toHard tbeli solution as 
jucb' as possible vlthout reliance on 
others,, wocking on the task idthout ' 
, constant supervision. Scntetiiiies de- 
: Bcrlbed as beinf "inner directed." 



Itoderately self-directed; occasionally 
requires general direction and encour- 
agenent to begin ti^ks. ' 



Qbable to anticipate problems. 'Re- 
tires frequent si^ervislon land re- 
assurance.. it very cdifficult to 
tfork on.his own. . . . 
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,2.00 ^ 



1.25 



^1.00 



0.75. 



0.50 



.^.25 



-^0.00 
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Biis student could beNppectefl tp find his (m thesis 
term project subject, witoout the help of a faculty nfim- 

ber, and to proceed in. the Initial stages of the study 

vithoiit specific guidance itm a facjilty member, 
business gaioes or group lining efforts, this student 

cOuld be expected to ewluate the problem' independently 
' 'anirto take the lead'l4 suggesting- methods of Solution. 



— Without any specifj^^ suggestion by anyone, this student' 
, could J)e expected to make an appointment to discuss a 
1.50 question he had about a point a professor made in a 
, lecture. ' . 



-You would expect this student to find sources of- j^orma- 
tion beyond those suggested initiaUy.by the professor, 
' but he wuld require some general direction beforehand. 



-M wodf not expecf this student to volunteer in clas? 
discussions, ;thougb he might be well-prepared when 
called on. 



-^en required^to prepare an asslgmuent on a topic 'of his 
own choosing, this student would require an instruc- 
tor's help in finding a t(Opic knd later on would have 
to be checked on to see that the job got donfe. 

-In conducting a ftsearch project, Ms student could be ' 
expe'ctea( to depend upon scneone else for the sugges- 
tion ofiwi" topic, definition of the problem, and 
direction. , ; /' 
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Figure 2 
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Modal Allocation of . Examples by QuaOi^y 





' Initial Pool* 


Retained Examples 


Qjiality ^ 


N ' 




N 


It 






6k , 




80 


am m 9^ ^ ^ ^ -I- # I 

Self -Development \SDJ 


20 


7 


Intj&rest in Mftnftg**TiP"^- invo-Lveinenx 


11 


68 ' 






Jferspective and BreacLtn or luioTir-Leage V"/, 




' 70 


5 


80 


Technical Itoowl^age ^TK^ 


. 10 • 


58' 


3 


91 


Critieal Awareness (CA) 


Ik 


59 


5 


•77 


Problem Analysis Ability (PA; . 


26 


58 


5. ' 


m 


Resolution and Decisiveness (RD) 


19 


71 


6 


89 


Planning for Implementation (PI; 


15 


68 


5 


85 ' 


Cosnnunlcation Skill (CS; 


16 


87 


5 


97 


nanagerxa-L gn. 1 1 1. xroo y 


• ^ 11 


65 




— 


Enthusiasm (E) 


15 


67 


6. 


81 


Initiative \J.J 


22 


60 . 


7 


79. 


Persistence and Driv6 (H)) 


n" 


' 70 


•J 


78 


Flexibility (f) 

... 




62 


7 


71^ 


Consideration (C) ^ ' ^ 


■ 21| 


71 


7 


92 


Average 


. 15.9 


67 


5-8 


81^ 


-Total " 


. 259 , 




■75 





ERIC 



l'9 



f '^The "modal allocat^^n" is that quality to which the largest number of 
Judges assigned a particular Example. 

*The percentage given for each quality is the average percent agreem^t 
aiQong the Judges for the examjples designed for that quality. 
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The general- reswlts from the reallocation were encourag^jig . Averaging 
across all exaxnples^ 67?t of the judges agreed on the modal assignment of 
examiples. Agreement ranged fro© ?5?t to iOOjt for specific examples. The 
averp^^agreement in assignment to modal quali^fcy for items retained 843 
amchors for the scales was 81f^. ' / * . ^ 

Examples for a given qx^lity were not always well distributed across 
all levels of the quality. It appeared easiei^ to get illustratlonp' of veiy 
high and ve^ low levels of A quality and relatively more diffictat to obtain 
Illustrations of the less e^reme levels. As described e^arller, less ex'^reme 
•examples were developed tl^ough revision of inltial^xainples but^ even so, a 
look' at the anchoring examples in the scales in Appendix' C shows that there 
/ is inadequalie coverage of some levels of a few of the. qualities. 
\ Judging from the modal agreements" the qualities chosen were distinguish- 

able and behavioral examples were found which provided relatively unambiguous 
illustrations for particular qualities. For most of the scales it was posr 
sible to find five or more itemis for which there was at least 80^ agreement 
in reallocation, and in addition were adequately distributed as to level. 
Qwite often there were examples .that showed high agreement but were at about 
the same level pn a scale . In such cases final selection took into account 
the contellt of the different examples in an attempt to iatroduce a range of 
behaviors in the, illustrations . 

Detailed results (?f the reallocation and Judgment of level are presented 
. for each item and quality in Appendix D . 

Two qualities (Interest in ManageAient Involvement and- Managerial Skill) 
were eliminc^ted primarily because of the content of the examples assigned to 
them* Usually these examples were very general and did little more than 
restate the general definitions of* the qualities. Also, managerial s-kill vas 
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iisually interpreted very broaic|iay and was seen as a conibination a msnber 



of other qxialltlbs' 



r 



Thus;' this first phase rtsrilted in the development of 13 scales ready 



for pilot testing in the scjiools. 
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Part II: Development of Bl^agraphic'al Data Form and Pilot Testing ' 

^ • , 

Ptdor to the pilot testing it was necessary to develop a ({Uestionnalre 
( for collecting bij^graiihlcfla Infarmatlon tram the students utaS were rated. 
This was for two reasonB^ firsts to atigment xoidergraduate grades and test 
scores as predictors of graduate school performance and^ second^ to have a ^ 
. m^ans of investigating the background and persoi^a2rt££ca*acterl8tics of the 
students receiving high and low ratings* )The']^jor(orlglnal purpose of th^s 
line of resecLTch was to, investigate ways^of broadening the basis of graduate 
scihool selection* This reqalred not only iMre coapsrehehsive criteria (grades 



and fa&ulty ratings) but also more coniprehensive^iaredictor^ (previous ^rad^ 
test scores and^ biographical Information)'. 

Work by Taylor and his associates (Tayldor & Ellison, 19^; Taylor & 
Holland, 196t|-), Smith, Albright, Glennon, and Owens (I961}/ England .(^.961), 
KLeln and Owens (I965) and a conference report edited by Henry (I966) Indi- 
cated that predictability could be Increased by the use of biographical da* 



data 



with a variety of criteria and Settings. As mentioned earlier^ however^ ^ 
Hilton and I^ers X^^^T) reported that such potential did not materlaliase when y 

GPk was the sole criterion. Ibey found that the particular biographical ^ta ^ 

-\ ~ 

they used could predict -ttils criterion> but that such data added little beyond 
that provided by conventional aptitude tests. Obey concluded that a bz^)ader ^ 
.criterion than that provided by grades was necessary in order to realise the 
predictive validity of biographical data^ 
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I ' . . ' , Ppoceoerp \ 

^ BaclggcTupdl Data Questionnedre . V 

3^ ^ 

The Backff^ound Data Pom (BDP) consists of a compilation /Ctf the more 

objectively scorable items on the application blanks currelrbiy in use by 17 

4 graduate school's of btisiness administration and of other items vbich a review 

of the literature suggested might be of value. A* specimen copy of the 152- 

item questionnaire is^ Included in Appendix^^ E. 

•Vj Through inspection of th& frequency data and item dJiitercorrelations, 

t 

the 109 BDF variables were reduced tb 71, with lack of meaningful range 
' being the primary reasons for elimination of variables. Tl^e 7I variables 
were tlien factored, with I's in the diagonal. The loadings Df each of -tiie 
biograjiiical items on the principai||g3Ces are shown in Table 5. Finally, the 
one or two variables loading highest on each axis vere selected for a step- 
wise multiple regression analysis in which undergraduate grades, ATGSB scores, 
and biographical information were the predictors eind graduate school point 
average (GPA) and faculty ratings were the criteria. 



Participants 

^ Two graduate schools of business administration participated in the pilot 
study, one located in the Midwest with a first-year ci!ass enrollment of 290 
and the othep Iqcated in the Bast with 90 first-year students. Each faulty 
meniber rated 10 of his or her first-year students. The selefctior^of the stu- 
dents was random except that each student had to be rated by two different 
facility meinbers.'- In the Isurger of the two schools 130 ratees were aussigned 
to 26 fetculty raters, and in the smaller school 60 students were assigned to 
12 faculty raters. The use of the rating scales was described to the facul- 
ties in a group meeting for each school. 
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Tkble 3 



Loaillngs ot Blogi^jblcal Items on nrlnelpal Axes 



i 



\ 



^-r^ 

/ Pjrinclpftl Axes 

2 • 3 k 5 6 7 



Variable 



8 



9'' 



10 



1 Age ' .79 --29 

2 Years married .76 -.29 

3 Rsnk in nllitaiy (Sri- 

Tate « 1 to Captain a 3) -.26 - 

4 No. of nonptaysical 

hobbies * ^ 
3 No. of seni-active 
bobbies o 



i 



.1*6 -.26 -70 



\ 6 No. of physical hobbles 
T^No; of bobbles pursued 
as an Izidlvldual 

8 No. of small group 
hobbles 

9 Hgw no. of years each 
ho^by pursued 

10 tfean hours per oionth on 
each hobby 

11 No. of nenibershlps in 
business org's 

12 No. of nonbusiness 
nenhershlps 

No. oj^, nonbusiness 
commmlty org^s 
llf Interest In teaching 
and research 

15 No. of boolcs owned 

16 j^whlch are fiction ' 

17 No. of applied subjects 
represented by books 

16 No. of business subjects 
^No. of science^ math. & 
^ Eng. subjects 
SO^No. of soc. scl. & 
humanities subjects 



.56 

.25 



.25 .26 

•29 
.32 



.32 

.39 
.60 
.32 
.56 
Ai 



.26 



-.31 



-.26 .27 



.27 



.26 



.3a 



J 



-.26 



.32 
'.3'^ 

.40 



.36 



.30 -.1^5 




.31 



.31 



.23 



^Asterisks denote variables included in stepwise nultiple correlations. 
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T»ble 5 ~( cont'd) 



Variable 



2 



Principal Axes 

k 5* 6 7 



8 9 10 



21 Slae of borne town 

22 Recency of decision to 
attend grad. school 

23 Pays ill in last turo ^ 
years ^ / , 

2if^o. of illnesses 
2^^lieral health; 

26 Fa'Uier^s education 

27 Mover's education 
26*No. of brothers 

29 No. of sisters 

30 No. of olAidBt siblings 

51 GBk in first semester 
32 Spouse's education ^ 
35*Iievel of, father's. 

occupation 
^ Level of mother's 

occupation 
55*H.S. attended, public 

(0) or private (l) 

36 Size of H.S. class 

3J No. oi colleges attended 

38*College attended in sajne 

state as grad school (l) 

or not (0) 
J$ Business degree (l) or 

nob (0) 
40^Any bus. sajors or nd- 

nors (1) or not (O) 

kl Technical or applied 
subjects ;ta3cen (l) or 

not (Ok 
If 2 No. of v.S. acadeniic 
awards 

If? No. of other H.S. awards 
4^ No. of coll. academic 
acwards 

No. of other coll. 
amurds ' 



.26 
.31 



-.k2 
-AO 



.26 

.27 



-.29 


-.53 
-25 


.27 

- . 26 « 


-.26 


.25 

-.29 


.31 

.26 

.3^^ 


.25 






.25 


-M ' ■ 


-.,26 


-.25 


-.42 








.26 



.52 



-.30 



.63' 
"38 



.25 



.26 
-.26 

..55 -^1 
..63 .32 



-.35 



.50 



.35 



.31 



.32 



.56 
• 58 

•37 .3U 
-.36 
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Table 3 (cont'd) 



V 

Varii^le 



, I^indpcU. Axes 
3» 1* 5 6. 7 



8 



10 



46 Grades accurately re- 

Aect ability (l) or 

not (O) 
47*Plaxi to go on for Hi.D. 

(3) or xmcertain (2) 

or not (l) .27 
k6 No. of bus. club nek- 

' bersbips 
k$*Vo. of social club and 

fraternity mendsenhips 
30 No. of bus. honoraxy 

memberships 



51 No. of nonbus. honor- 
aries 

52 No. of offices held 

53 No. of individual sports 
3k*Ko. of team sports -.29 
33 Years as manager or 

captain 



36 Anxt. of conscious 

career planning 
5T*0riginal confidence in 

career chdice 
58 No. of summers in 

school or work -.^ .23 

39 No. of sibmers in 

travel^ etc. ) ' 

60 No. of school years ^ 

employed .kl 



6l*Hr8. employed per week 

vhen undergraduate .29 .38 

62 Years of full-time 
employment .82 

63 Averag»''aS^thIy salary .6k 
6^ Debt acquired as 

undergraduate '5^ 
65 Amount borrowed for 

grad. work *29 .1|6 



.56 



.26 



.kl 

.27' 



.36 



.32 



.33 



• .27 
.36 -.57 
-.36 



- .33 




-.30 



-.28 



.26 



-.31 



.26 



AO 
.38 



..27 



-.34 



"i^Asterlsks denote variables Included in stepwise multiple correlations. 
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" ;.Table 3 (cont'd) 



^ Principal A35|S 
Varietble ^ . I 3 ' J» $ 6 7 8 ' 10 

66*Addit;J^onal debt expec1?ed ; .26i .lt9 ' .50 \ -.25 

67 Amofunt owed for constoner 

goods ' ' . . .29 . ^ --55 

68 Total current assets ^ '-.k3 .'30 • 

69 Total current debts .25 .60 

70 Financial gifts expected -M -.28 -i*. 



71 Amount life insurance * 

carried .35 M 



^Asterisks , denote variables included in stepwise multiple correlations,, 



Rating Procedure 

Copies of a manual (see Apl^endix F)> the anchored> rating scales 
(Appendix C), and a record fonp on v^ich to record incidents of performance 
(Appendix G) were, given to each ratexu^ The faculty were asked t o malDB a 
running record, preferably after each class or at le^-st once a veeHi of the 
incidents they had noted on each^of Jiheir iO ratees. The faculty were told 
that they might go out of their way- to call upon their ratees^ class if 
they wished, or confer with them aftfer^ class, but that the chief relianei^ 
was to be placed on natural incidents which came spontaneously from class 
interaction with these students'. In addition, the .faculV v«re told that 
they did not need to find or record incidents for each ^cale for each student. 
They were to .consider the rating scales as convenieril^locaticms^o record 
such Incidents as weije observed if these incidents fit one or Acre of the 
scales. Incidents might be recorded and reported >rtiich did not fit the v^* 
scales developed, and some scales and some students mi^t have no Incidents 
recorded for them. : ^* ^ ^ 

Three levels of specificity of ratings ver^ noted in the ,use of the/ 
anchored rating scales . Raters who complied most fully with the directions 
for the use of -tiie scales reported several separate incidents on each ratee 
on ai^ one scale axA rdted/eaoh of these incidents separately. - Then, ccoply- 
ing with the insti^tlons, 'the raters gave an overall cco?)osite score, form- . 
ing their own.,imprestfion of the central tendency of the separqfe incident 

V ■ ■ ■ - . , • . ■ ' /' 

ratixiigs f or "^t ratee on that one^cale. ^ ^ 

Other ^ raters "who complied less fully with the instructions may' have ;indl- 

c • ; : - * ■ ■■■■■■■■ 

cated that several incidents occurred, mentlonirjg behavior such as "vrittea 

work often turned in late," but did not rate iihe incidents themselves/ 



Th^ third and least specific level of ratihg was represented by tnose 

', ' ■ ' .4, - 

raters ■wbose railings were ioaade on a global basiff only. These raters each 
gaVie a sximinary rating fat one ratee on one scale but did not report; specific 
incidents. - While some raters reported less confidence in such summsu^y ratings 
others believed that th^ could mate t^ese accurately by drawing lipoji Impres- 
sions of a variety of contacts with the studenta over the sejnester. 

^The formal observatioil pei-iod for the recording of observations was ^ 
about 10 weeks for each of the two schools. All faculty-member raters were 
contacted by phone, abait 3 weeks after the observation period started, to - 
answer any qiue'stioos about procedure that they might have, The telephone con 
tactiilso,;5feirved as a reminder and as a motivator for some of the faculty. ^ 
Samb^ facity members di<|, not piarticipate deispite repeated telephone contacts^ 
while other , faculty feflt that the observation perifcd was, too short or that 5 
students should have been observed instead of 10.. 

At the end of the observation period and before final grades were oalcu- 
lated for these ratees, the faculty raters were also asked to make two other 
Judgments about their ratees: • an overall impression of their performance, and 
an estimation of how well acquainted they were with' the ratee. Guidelines 
were provided on the rating scale for these Judgments to further consistency 
among the judges.," 

^ Other "control" data collected on the raters themselves were the nuijaber 
of years of teachljag experience) thet^size of the, class in which they observed 
the ratees, ^ and the tfinal course ^^grade the rater gave the ratee. Control dLata 
»n the ratees were also gathered in the form of ATCSB VerlAl, Quantitatii 
Total test scores, and the total grade point average for the semester 
(i^ich, 'Of course, included- the' rater's individual course grade). 




^ THe results to be reported are based on a*p,pollng of the daia ^roo the 
tvo schools. In niDst respects the mean scores for the schools vere qiilte 
similar • The mean undergraduate GPA of ttie students enrolled In each school 
were 2.6l and 2.77 with atandard devifitions of .52- and . 56. Thus they dif- 
f ered by approKinat^ly one-half a standard deviation. The mean ATOSB-Q 
scores differed by 5^6 of the standard devjaitionj^ and the ATCJSB-V by 20^. • ' 
The mean gradmte GIA*s were 2.59 and 2.1|.2 with standard deviations, of .1*6 
and .55 Generally the mean faculty ratings were similar at the <wo schools, 
differing by fractiooai amounts cf the stfigidard deviation within either \ 
school. , These resuI^K^^Jiong with the general obse:^tions of s imilar admis- 
sions practices and standards at the two schools sefmSd to jiostify pooling , 
the data although it was recognized that' pooling introduces the possibiiilqr 
of confounded results. -b; 

Results . , 

A total of 597, students at the two schools' fined out ;^r^Bacligr.ciund 
Data Form (BDP). Facjilty participation as raters was notlcesbly poorer at" 
the smaller of the two schools, but for the total of 57 raters ashed to 
participate (one of the original 58 raters died) 19' percent) gave at 
least 16 ratings which complied folly with the request for separate incidents 
Individually rated^fltad, then made into a ccoposite, 10 (27 pe^ent) did hot 
participate at all, and' the other 8 ratiers were evenly split between thpse 

idko gave a compoBlte ranting backed up by the nunber of Incl^kpptSi and those 

<t. ' , . . ■ - , ■ ' 

idio gave^ composite scibres ohIjF • ' Tfiirty raters gave judgments 6a th^ ' Isqportaace 
pt the 13 rating scales,, cwt of a**. total" of 57 uho could have participated, with 
21 ccaidng'flrom. the larger school ^^'9, ftpom 



Ltles 

^^^^^^^ 

One reason for gathering, the rating data was that the comparison and 
• conft>lnatlon bf judgments from two raters on each rat ee would provide an esti- 
mate of Interjudge reliability and enable It to.be Increased. The nuniber of 
studeivts wl"^ two ratings varied from scale t"p^ scale, ranging from kS to 81. 
With 10 'faculty| members not participating, however, a large^,'^ prestjmably non- 
random fraction of students did not have two ratings . The reliabilities 
reported in Table k must, therefore ^be regarded as rough approximations. 
They are intraclass correlations modified to estimate the reliabitlty of' the , 
sum of the ratings of two judges (Guilford, I965, p. 299). The reUabilities 
-^indicated that on socae scales— Plexibility for example— the faculty raters . 
<-aiffered so gi?eatly in their rating that we should question Ssing these scales 
in future research. 

Intercorrelatlons ^ 

The first analysla of the data wa& a matrix of ^oduce moment 'eo!rreiatl6ns 
among all the variables of the study. Table ^,-5 shows the intercorrelatlons of 
the 13 scales. The c6r3?elatibhs are based on differing N -'s, with mq|t of 

•■ ■ , . • ■ ■ 

. . ■ .. \ '. ' ■ . . ■ ■ ■ ■ <r» , ' ■ 

the N *s 80 or higher and the range from 5^ to 553- Inspection of the inter- 
cdrreiationa suggests that one , cluster might be called "Technical Problem 
, Solving," consisting of technical Imowledge, problem analysis, and critical 
dtrareness. A second cluster might be called "Drive" and would consist of per- 
sistence, initiative, enthusiasm, and self -developnent . 

3h addition, the aveirage level of Importance which the raters attached to 
each of 13 scales was obtained. (Each f enmity member ranked the scales and 
the ranks vere converted to a scale vlth a mean of ^0 with standard deviation 
of 10* ) Table 6 shows these rankings on the left, while the columns on the 



The results to be reported are based on a pooling of the .data frcxn the 
two scho9l8. In most respects the iDean scores for the schools vere quite 
slxAllar. Hhe mean undergz*aduate of the students enrolled In each school 
vere 2.6l and 2.77 vlth standard deviations of .|l and .36. Ihus.they dlf- 
fered by approodjnately one-half a standard deviation. The mean ATQSB-Q . . 
scores differed hy of the standard deviation, and the ATGSB-V by 20^. 
1!he mean graduate GBU's vere 2.59 and 2.{i-2 vlth stajidaxxL deviations of 
and .55. Generaliiy the mean faculty ratings vere similar .at the tvo'schools^ 
differing by fractional ainaunts df the standard deviation idthln either 
school. These results along with the general observations of similar adsds* 
slons practices and staqdards at the bro schools seeiaed to ;)ustify pooling 
the data althougit) it was recognized that poollng«»iintroduces the posi^lbility 
of confounded results. • 

^ / Resiilts 

I ^ .• •). 

A total of 397 students a^the tvo schools' fllfted out the Background - 

■ ;. ■ . J ' _ ■' . , ■ • 

t * , * . / ■ : ' 

Dat4. Form Xbdf); Faculty participation as raters vas noticeably poorer at 
the smaller of the tvb scihoois, but for^ the total of 37 raters . asked to 
part^lpate (one of^the original 38^ raters died) 1$ (31 percent) gave at 
least 10 ratings vhlch coo^lled fulOy tdth the request for separate Incidents 
IndlvlduaLly rated and th^ made into a ccoiposlte^ 10 (27 percent ) did not 
participate at all> and the other 8 raters vere evenly split between those 
vho gave a canposlte rating backed up by the nunfcer of Incidents, and those 
vho gave cooiposlte scorea^^only. Thirty rateirs gave judgments on the ijqpartance 
of the 13 rating scales, out of a total of 37 vho could have participated, vlth 
21 pooling from the larger school snd 9 trm the smaller school. - 



Reliabilities 

One reason for gathering the rating data was. that the comparison and' 
combination of - Judgments from t«ro raters on each ratee vould paravide an estl- 
iMite of Irtterjudgjs reliability and enable It to be increased. Hie maiber of 

students with two ratings varied' from scale to. scale, ranging from 46 to 81. 

* _ ■' • 

.With 10 faculty members not participating, however, a large, presumably. non- 

'l . ' 

random fraction of students ^ not have iwo ratings . The reliabilities 

reported In, Table \ must, 'therefore, be regarded as rough approoclnatlons ; 

They aire intraclass correlations modified to estlinate the reilablllty of^ the 

sum of the ratings of two judges (Guilford, I965, p. 299). 'The reliabilities 

Indicated that on some scales— Flexibility for exaarple—the faculty raters 

differed so greatly 'in their- rating that we should question using th*ese scales 

in future research. . ' 

■ ■ • ■ I ^ ' , ■ * • , 

IntercorrelatlonB . 

Hie first analysis of the data^vas a matrix of produce moment correlations 
among all ^ihe variables of the study. Table 5 shows the intercorrelations of 
the 15 scales. Ibe correlations are based on differing N 's, with xoost of 
the N 's 80 or higher aijd the range from ^ to 555- Inspection of the inter- 
correlations suggests that one cluster, might be palled "Tecimicol Eroblem 
Solving," consisting of technical knowledge, problem analysis, and critical 
awareness., A second cluster might be called "Drive" and wpuld cdrisist of per- 
sistence, initiative, enthusiasm, and Self -development. V 

In addition, the average level, of importance which the raters attached to 
each of 13 scales was obtained. (Each feuniLty member reuilEed the scales and , 
the ranks, were converted to a scale with a mean of 50 with standalrd. deviation 
of io*) Table. 6 shows these rankings on the left, IrMle^ the columns on the 
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TabXe k 

Aifreement Between iTudgef for Each Rating Seale 
(It's - k6 to 81) 







r^J 


1 


Self -Development . 




2. 


Perspective 


V .71 


3 


Technical Knoirledge 




1. 


Critical Avarenesii 




5 


PrpbJInn Analysis Ability 

,• * 


< 

.70 


6 


Res olut Idi 


-.02 


7 


Plannixis 


.59 ^ 


8 


C<»niuiiicatlon 3]^11 


,kl 


9 


Enthusiasm ^ 


,2k 


10 


Initiative f 


.58 








11 ^ 


Persistence and Drive 


•35 


12 


paexibiUty 


-.65 


13 


Consideration 


*.0''^ 




Tabled 




InWcomlanonp of ^ties Rated Sample: ' Fooling 'of tot^|BcbooU 



i 



/ 11 1 ^ . / I i 
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Qoftllty Bated „ , y 2 3 l^ 5 6 ? 8 9 10 U 12 13 

1. Self-Dewlofoent 

2. FerBpectlve & Breadth ' 

of Knowledge - , 1-^ 1^ - „ j.yj^ ,.x v ^ 

3. Technical Knowledge ' 
Critical Awareness 

5. Eroblem Analysis Ability , ^ 
*6. Resolution and llecisiveness 

i ' 

V Planning for loplenentatlbn 

8. Ccnpinication Skills . , ' 

9. Sathusiasn 

10. Initiative 

11. Persistence & Drive 

12. Pl«ability 
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25 


38 


58 


66 


64 


31 






'61 


1 

23 


7^ 


51' 


'50 




^5 


IB 


60 


^2 


•35 


56 


3^ 




35 


21 


(A 






l^2' 


60 


M^ 


■56 




58 


16" 




55 


\2 


T5 


If? 


53 


\0 


31 


16 






31 


53 
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26 




16 
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16 
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Ikq>ortuioe of Rating SoaXaa to Faculty, and ComlatioM of Ratings 

and Captain Othar VarlatolM vith Flrat Sanaatar OIA ' ^ 

* « 



Qiial|^ Ratad 


Faculty Ratlins 
of Unportanoe 

3f S.D. 




Correlation with 
First Semester OM 

Ratlj^ga 


1. 


Salf-Developoaaht 


U5.I ■ 


10.8 


.17 


81* 


1.3 


0.5 


2. 


Psrapaotlve 


51.5 


9'.9 J 

1 


.51 


77 


1.2 


0.1* 


5. 


!Deohnlcal Khowledge 


1*8.5 


8.7 " 


.51 


99 


1.3 


. 0.1* 


4. 


Critical Amureneas 


50.1 


10.1* i 

1 


.58 


83 


1.3 


0.1* 


5. 


Rroblam Analysis 


60.9 


8.5 1 


.1*8 

t 


117 


1.3 


0.5 


6. 


Hasolutlaai 


1*6.5 


8.5 


.25 


83 . 




0.5 


7. 


planning 


U8.7 


9.1 ' 


.26 


86 


1.1* 


o.v 


8. 


CGmiBinic ftfclon 


52.x 


7.8 


.25 


115 


1.3 


0.^ 


9- 


.^tkltutlasm 


1*8.9 


7.1^. 


.22 


120 


1.2 


0.5 


10. 


Initiative * 


: 5!* . 8 


5.9 


^ 


92 


1.2, 


0.5 


11. 


Peraiatence 


52.1* 


8.0 


.57 


85 


1.1* . 


0.5 


12. 


Flexibility 


*^6.5 . . 


6.5 


.15 


75 ■ 


1.2 


0.1* 


i3. 


Ccoaidaration 


1*1.5 


7.1^ 


.20 


|9 


1.3 


_0.4 


^• 


OveralX#atingB 






.1*1* 


136 


1.1 


0.1* 


15- 


Degree of Acqaaintance 






.12 


165 


0.9 


0.6 


l£. 


Grade frcn Rater 






.1*0 


173 


5.0 . 


0.9 


17- 


Rater's Class Sise 






-.20 


173 


37.9 






Rater's Years of 
Teaching 






.05 


173 


15.3 


10.8 


19. 


First Semester GPA 






i 


251 


2.1* 


0.6 
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tifffoA of tii« tWble ahoir tta« oomlatloiui of the rfttinga with firit aenefter 
OHk. 

By laipactlon of Table 6 there la a tendency for thoae q^ialltlea 
hlglher In ioportanoe to corr^lata higher with OIA« One of the goida of this 
•tufSy^ however^ vmi.to identify rating vwrlablea^ if any> that are reaaonably 
independent of gradea and are predictable traax biographical data. If a poai- 
tive owrelation of .30 ia taken aa a diviaion line to identify ihoae variablea 
iAink are moat cloaely related to gradea^ the rating variablea that fall b^loir 
thla cutting point and agpe alao -rated cloae to or above the average of all 
the virlablea in liBportanee are variablea 1 (SelT-develoxnent ), 7 (Planning), 
9 (Boti^laain), and 10. (initiative)* Variablea 6 and 13> Resolution and 
Cooalderatlon reapectlvely, both gaeet the criterion of having correlations 
with QBl belour OOa but both ax^ alao the lomat in rank order of general im^ , 
portance aardn aU the ratera. It ia intereating to note that variable 3, 
Technical Khowledge, ratea aocoewhat belov the average in Judged linportance 
and atill provides the highest correlation (-f .51) with GTk. 



'■ The correlatlona-^ the rating scckles with the "control" vtarlablea bcuv 

^ I ■ - 

te flUBnarlzed aus folloirs: 

'1« ISie acalea have aaall poaitive correlationa with '^Degree of 

Acq:itftintance'^ (of the faculty iQeU>er with' the students rated). 

2. Moderate positive correlations (.21 to .61) irith the grade 

' ■ . " " ■ », ■ ■ • 

received in the rater U course. 
3* No correlation with the size of the ratee'a claaa. 
k. Small poaitive coxrelationa irith the rater's years of teaching 
eogperience . 

correlation iflth ATQSB VerbflO. scores* ■ > 



5. 



38 
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6. No ooirrvJtAtiOii with ATOSB Qu«atlt*Uv« aooorei, ifltb th« «xo«ptioD 
. of TtohnioAl XhoNlAdit .and FrdbM AiuOytii AblUty imioH irart / 

ooirre3At«dl .1^1 Md .31 rtipeotlv«ly> 
Ab «n exampltt at th« oon^Utiona of ^ r«tlng tcalM irtth tte 

b^ograj^icAl vwrUble*, ftibXe 7 !■ pirovlded. In riw at the conplwc liit«r- 
MlAtlcmfhlps fUBong biographioal data and the exploratory natura oC this 
pilot ftudyi no attoqpt will be inda to Int^rprtt tlMit mv* oordwr oomlA- 

tion#. * \ ' 

, Stepirlee miltlple regreeslona . Finally, to exploit the j owibla valaw 
of the bicgraphioal data in predicting the rating scales and grade point 
svBrage^ stepid.se Multiple regressions vere conputed tislng 1^ selected bio- 
graphical variables, ATOSB-Q, ATGSB-V, and tittdergraduate OIA as predictors. 
• Ubdergra^te GM, A^B-q> and ATGSB-V vere entered Into the prediction, in 
that order, before the blcgraphical data irere ailOMd €o contitlbute to the 
pradiction. This m done since the^prlnary interest ims to ascertain ^ ^ 
vbether biographical data might add significantly to the predlctioa provided 
by test scores and undergraduate QUA. OSie reader should Iteep in Bind that 
tlw results are not crojfs -validated axid^ thus / that there is no* vay of Imoir- 
li« hoir nich the >ifting of the 13 biographical variables nay have capital- 
iaed on fluctuations unlqpie to the saaqpGbe in hand. 

fable 8 shovs the results of the. stepirise prediction of graduate school . 
first semester GBA f or the coafeined sample of both participating schools. 
Qh^gradnate QTA, ATQ^fa^id AtgSB-V provid^til noltiple correlation of 
.39. When biographical^PI liere included three varisibles (father's oeo«sa- 
tioo, nuBdber of social dubs and fraternities, and age) increteed the anJI,tip3e 
R to .52. Their regression itelghts irere comparable to those of ^ladergradukte 



Viriablti VhlQh Correlate vlth Planning for Implewntetlon Soele 





Variable 




N 


X 


S.D 


••7 » 


riO« Ox nODDlQS pVlXBU^CL ftS 

an IndlvlduaLl 


.22 


87 


1.0 


1.0 


9. 


Mean no* of years each 
hc^by pureued 


^ .20 


82 


3.2 


1.9 




No. of bzothere 




86 


0.8 


0.8 






Pit 


Ah. 






31. 


• 

GPA. in first semester 


.26 


86 


2.4 


0.5 


38. 


College attended in saxne 
state as grad school 


-.25. 


64 


0.4 . 


0.5 


46. 


Grades accurately reflect 
vkuxxxvy or nov 


.20 


80 - 


1-9 


1.0 


47. 


Plan to go on for Ri.D. or 
Ascertain or not 


-.35 


80 

• 


0.4 


0.6 


57. 


Qrl^iJOAl confidence in 
career choici! 


.uo 


84 


2.5 


1.4 


60. 


No. of sdhool years employed 


.21 


86 


1.6 


1.5 


61. 

( 


Hrs . employed per veek when 
undergradtiate 


.22 


86 


23.5. 


29.6 



J 



^ Table 8 ■ ' . y^ .-^; ■ ■ ' 

standard Regretsslon Wei^ts and Multijple Correlations 

Criterion: GBA." ^ I. - 

(N b 171 ; both schoolfl 'eonblned) 




Ifodergrad. 
GPk 


. ATGSB 
Q V 


Father's ' 
Occupation 


No. of 
Social Clubs ^ 

and 
fraternities 


Age 


R 


• 

• 


.16 














>16 




.17 
.18 






.15 








.37 • 


■ 


.21 




.26 


.10 


.30 


, ■ t ■ 








.21 




-127 


.11 


.28 


.16 




.51 


r 

4 


.21 




•29 


.11 


.28 


.16 


.10 


•52 . 
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aiA eu9id the test scores, x Ihe suggestion is that having higher status peu:«nts, 
being sociable , aiid being mdre mature enhances one '* s acadeoiic grades . ^s 
thiSt^ecause such students axe actually more accaiQ>lished, or axe these 
meassires indirect loeasurea of ability whicte stJppleiiieht test scores and pre- 
vious grades as measoire of ability^ or is there a bias in assigning grades 
In fayor "of^such students. At this j)oint ft is impossible to tell; the qups- 
tion needs further research. 

Table 9 shows the predict ion^of ^Perspective by means of the same proce- 
diares as in the Table 8 analysis, "Same State" is a measure indicating 
whether the gradtiate school attended was in the sane state as the student's 
undergraduate school (scored l) or in another state (scored O). *'Conf. 
Career" reflects how confidently the student regard^ his current career^ choice 
In the ^^1^^ Btej? (bottom row of table ) one .c€in" see that GPA and the test 
scox^s contributeHo the j)^^ relatively less than several of the bio- 

graphical variables^ and that isome different biographical variables emerge / 
as predictors . ihe' new predlctorg may, l^owever, W alternative measures "of 
the same underlying^ variables. TNuttiber of brothers, " for example,- ±$ ^pro^ky-- 
bly a reflection of SDcioeconcmiq status in the same way father's occupation 
is. 'It has frequently been found that less affluent families have more ; 
children. In any case, the dynamics are no doubt complex and do not warrant 
further speculation here. V ^ 

The next criterion^ Consideration, was, selected for discussion since ^ 

it was relatively independent of tiie other criteria and also was one of the 

■ ' • ' ' "..^»^ " ■ , • 

less reliable criterion measures (as far gl& between Judge agreement wpts con- 

cerned). Nevertheless, the multiple correlation coefficients shown in Table 

10 are as hi^h as tfaoso of most of the other criteria. In the fjjial step. 



■ ■ '•• , i ■ , -36- 

■•' ■■• , • , ■ •> 

■ , arable 9 ■ ■ - [ 

Standard Begresslcni Weights and Multiple Correlations 
Crite^'ibn:. Perspective ' 
(N »i I7I5 bojgh sdbools coBibined) 



c'tors '■ 

Coil. ATGSB Ijro. of Sajne Conf. Father's No- of No. of 

GSA Q V Bros). State Age Career Occ. Cl^s Illnesser 



.16 
.16 

.17 06 ^09 . • • : ■ 

. . llf 

.13 

.11 
.11 

.12 



.11 

• 08 >09 
vl2 

>13_^05 

.16 .05 

;i7 .07 
•IL .09 

, .10 
.20 .10 




— 33 










- .29 • 






-.36 


— SB ^ 


.U9 




-.ifl 


— 29 


.21 


-.17 


-.42' 


-.33 


.21 


-.19, 


-.42 


— 32 


.21 


-.21 


-.40 


— 33 

• 


•23 


-.21 


9 



.16 
■,1B 
-,19 



,1k 
.15 
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standard Regression Wete^ts and Haltiple. CorreXatifmB. 
Ijrlterlon: Consideration 
(N a'lyij both schools eddb^^ 



Coll. ATGSB 



Itrs. 
Work 



Rredictors . ^ 

Plans lap . Frly. Father ' s 
Hi.D. . Hob . flch. N QcCf 



No. of 
Age Bros* R 




-.11 




mm 0m 


;-.iv 


.27 


: -.21 








I -■ 


-.14 


> . 26 


-.22 


-.21 






.OB'' 


-.15 


.29 


' -.20 


-.20 








i : 
-.15 


.32 


-.21 


-.20 


.16 


.15 


.10 ^ 


• .51 


.-'20 


-.21 


.17 


.15 


.12 


-.1(5 


•51 


-17 


-.22 


•It . 


•15 



.Ik 

•15 



.12 
-56 

/ .la 
M 

— 15 •51 



. y 
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coUejSe GIA bad no weight, ATCSSB-ft a small positive weight and ATGSB-V 
actually had ft neigative weight. Also the bipgraphical predictors were mostly 

. different from those; which emerged from the other analyses.. ("Iso. Hob." is 
the huaiber of hobbies >ihich the individual pursues independently. "Priv. 
Sch." indicates tfhether the student attended an independent (1) or a public 

\(b) sfecbndary school.) : 

Tableau shows what happened when a stanmary criterion was constructed 
^ by addj^ together the* rating scale scores and. first semester QiSk. "Age 
eroerged^as the single best predictor followgd^^ No. of Brothers and Under- 

> gr?uiiiate School in SaxttB State. Undergraduate GPA and the test scores con- 
tributed Mlatlv^ly less to the pred^ 

- As the^'^ia^t^ analyses similar to tl^e preceding were computed for • 
each' pairbicipatlng school separately. In view of the relatively sioall sainples 
involved the results will not be reported here other than the observation that 

^ the effective predictors tended to be the same in each school, although there 
.were Isome whiph were unique to each school. The regressioA-^eights differed 
markedly, however. 

/ , * Discussion and Conclusions 

■ " . ■ • . / ■ ' ^ * • . '■■ . . • > ' 

The main objective of this work was tq develop a set pf scales which 
would usefully supplement acadeklc gradeis as ^measures of graduate ;8Chool 
jattainment:' O^tes^authors * wprking hypothesis was that if the scales were , 
truly comprehensiveT-not merely a halo of academic grades— then biogi/aphical 
information would usefully supplement past grades and , test S(bores as predictors 
of a cooibined criterion made "up oj^ grades and ratings. J\idging from the low 



standard Rei^ssipn Weights and Multiple Correlations 
/ Criterion: SubhmI^ Criterion* 
(N * JLTl} both schools ccmblned) 



Uhdergrad. 



AT6SB 



^^edlctors 
No. of 





Q 


V 


Age 


Bros 


.13 








t 


.13 


.09 










.06 


.08 






\2h 


.14 


.07 


.32 




.13 


;lB 


.05 


.32. 


-.26 


.12 ■ ■ ■ 


: .IB 


.05 


.30 


-.29 


\ 

.10 


.16 


.06 


.31 


-.29 



U.G.' Sch. 

in. 

Same' State 



U.G. Social 
Science 
Me^Jor 



R 



-•22 4 
-.23 




-.08 



*13 
.16 

.17 

.56 
.1^ 

.50 



. ^ach rating 
S.D.*of |ld. OSie s' 
sumnaxy criterion 
ipissiiig. 



6 GWl vas ' standardized with a mean of.'y^ and a 
, criterion is the average of these scores. No ^ 
icarpiuted when three o* more of the part scores were 



positiv^ correlationff between the scales and graduate scfaool grades the tech- 
nique of behaviorally^ anchoring the rating scales did result in their being 
adequately independent of grades. In other words. the faculty di^ not routinely 
assi^ liigh ratings to good students and, low ratings to weajc btudifhts. In 
addition, the mixed pattern of rejktionships l^he scales supports the 

view that distinctions were made among the sca||s . The faculty raters appar- 
ently paid attention to Sie def^tions of the scales. This conclusion is 
also supported by an inspectfo^of tbp rating sheets submitted by each faculty 
member; seldom did individual students receive exactly, the same rating on all 
scales. It' did happen, however— in perhaps 10^ of the cases— which underacores 
the importance of soliciting faculty raters who are willing to make thoughtful 
discriminations in assigning ratings. 

Whether the scales have reliability and validity Is another question. 
About half of ' the scales had adequate reliability In tii?t^^ flense of between 
Judge agreement, although missing data left the reliability estimates sjrt^Ject 
to question. In any case the correlations with performance and biographical 
data suggest that the scales do have validity. Generally the correlations irere 
about the magn^feiie and direction one would expect on the basis of previous 
research. The ^st suggestive evidence, however, derives from the stepwise 
multiple regr^'^sions. By and larg^ the multiple Jcegression coefficients -for 
the prediction of separate scales were as high as those for the predictic^ of 
grades. By^n these must be interpreted with fcaution, however. When a large 
number of /rariables are sifted— as in this pilot study— it is difficult to 
estimate . /how much one has capitalized on chance relationships . We will i^ere 
more confidence in the validity of the scales when, In future research, they 
are us^d in a variety of schools and continue to exhibit validity. 

■ ■ /■ . ■■ ■ . ■■ ■ -■ ■ ■ . : 



The mare certain outccsnes gf thL& deve^inoental effort concern tbe 

, ■» ■ ■ . . . • . 

characteristics and use of the scales. GeneraUy the scales vere veil 
received, as a substantial imprcYenent over conventional rating techniques. 
tEhe records aiid ccoDDents provided by tlie faculty raters did, however, poinb 
to a.piuniber oiT ininor revisions/ xnostly r^^ from anibiguities in the 

definitions of qualities and behavioral examples provided. Appropriate 
changes IfiU be made in the scales in tbe next phases of this line of research^ 

Also it vas clear that changes are necessary in the rating procedure^ 
chiefly in 1^ ntonber of -ratingfii each faduliy meniber is dsked to mate. Ac- 
cordingly it was decided to reduce i^e number of scales from 13 to 7 and the 
nusdber of students each faculty member would be asked to rate from 10 to 5- 
Whiqh seven scales were selected and the basis ;fOr selection will be described 
In detfljil in a subsequent report. ' 

All the scales nay be liseful in future research^ however^ depending on 
the specific purposes of the research. A possible exception is the Flexibil- 
ity scale. As noted earlier the, agreement between the Judges was so low — 
actually it was negative — that the scale should be redone before It is used 
again^ unless a maore adequate check demonstrates it has more reliability than 
found^here. ' 

Certain step^ in administering the scales are critical. The Impprtance 
full cooperation on the part of the raters cannot be overemphasized. The 
raters must be carefully instructed in the rationale and purposes of the 
scales* Prior to iising them they should become thoroughly familiar with the 
scales^ the general definitions of each qxiality^ wd the content of relevant 
behaviors used to illustrate the qualities. Finally^ well in advance of the 
act of rating^ the Judge, should know whicli students he is to rate in order 




that he can dbsexnre them over a period of several veeks^ paying particular. ' 
attention^ to incidents relevant to the qualities. 

Qxe Background Data Form proved to 1:>e satisfactory for the purposes of 
the research . A broad range of biographical facts irere tapped. [ But in the 
future certain questions^ (e;g.^ in the area of personal accasqE>llshments ) 
should be added. It ahould also be refoxmuLated to include a maximtt ma^ 
of multiple choice items ijaresented in a wety \fhich wotad "be largely madalne 
scorable—to reduce the extensive clerical expense incurred in the research 
to date. 

The ansdysiS; of, the bioep:tipbic|5^1 d^a indicated that they ^Kte^lat^d 

^ Important vays to grades and to ratings. Certain data predi^^padcr and 

other ^biogsraphical facts, frequently different, predicted the ra* 

bined with undergraduate grades and ATSSB scores, biographical data shoir 

promise of increasing the po^edictlon of graduate school grades euid criterion 

ratin^T To predict grades^ a mix of undergraduate grades, ATQSB scores, t 

and biographical data vas used 'which ms generally different from the mix of' 

these variables which best predicted the rated personal qualities . Again, 

however > it must be pointed out that the ccniblnatlon of variables chosen Is 

"best" only for the existing samplL; some other set of jpredlctors might well 

be superior in a cross «rvalldatipn sample. 
* ■ ' ' ■ 

Future resjearch should be undertaken with the f ollcwing objectives: 

a. To test the preliminary findings presented here on a much 
larger sample, more representative pf range of business schools, 

b. To reflate the scales and the Background Data Form for dpera* 
tlonal use in the schools, 

-c' To test the effectiveness of revised rating procedures, and 
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4_^''To- Irusareaf e of the findings ajwL^ acciaracy of 

• predictiT» eqUatidns. 
^ conclusion,, this xepoirt describes a five-year effort to develop a 
set of scales toT i^se in graduate Softools cS business and industrisil * ! 
adniniati«tioo.--8cale8 -idiich would not be subject to the shorteonings of 
tra&tiooal rating tecihz4qu98v Oaiey refresent several^nan-years of irork on 
tlie paar^^ef'^t^ principal investigators and hundreds of hours of ccmsulting 
and coUsboratlon en the part of cooperating faculty mesibers. \(hether'the 
effort was Jtistified will only be known when the results of future research 
are in hand. In one sense, however, the scales stand by -^A^pselyes in that 
they delineate a broad set of htnum qualities which the research staff sad 
its faculty collaboratars regiarded as' Important, and these qualities We 
defined 6U3 precisely and concretely as current techniques woul^ allow. 
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The ATOSB Criterito Stfci&r Rating Scales v 
Pretest ItM 



Iteese Iteu are not mmbered tn say particular order. • * ^, 

■ ■ . • ■ ^ ■■' ■ ' '■■*»■' 

1. This student would be able to Manipulate correctly a iiathaMlllcalJprDeediJre, but 
would h6t be able to state the major assuHptione on which tfll nethod Is^basM. » 

2. A case prdbleai of noderate difficulty is being discussed in 'h/im» 

wltli the need to «ake a decision without all the facte necessary, thii^^j|«>t 
iicittl4 be expected to acknowledge that he should have nore inf onnation, wS^i«l 
based on certain essueptiohs, to recdaaend a decision about the ease. 

3. this student iiould be unresponsive or bored, even during a lively slJnS«tion \ 
eocercise in which several teams go bankrupt giving him the opportunity to sew , 

] thinge up. 

1|. This student could be eaqpected to present an oral rq>or#in idlich he aalb^s 
>{torogatory remarks about a certain economic theory without noticing that many 
< «flaA>ers of the audience are higMy identified with the theoiy. 

* ' ' ' * 

$, Tou can always expect this student's case discussioris to^be presented in an 

iliteresting way which makes it appear -that. he considers every problem iiq^wrtent. 

6. Because of his knowledge of fbjb needs and interests of ths group, this student 
. would sOTse iinaediat^ that fes contribution to a discussion was being 

• negatively, received . * - • ' 

When faced with a research paper assignment, with many other deniands on his time, 
this student could be expend to tackle the job bnthusiastically, do a thorough, 
search of the literature, w6rk late for several nights,-* pass up social activities, 
finish the paper well ahead of the deadline, ^nd sublimit a complete and well 
dociimented r^rt. ^ 

8. fhis student could not state ill an unambiguous way the key definitipns arid 
established procedures for organising kflpiedge in a field covered by required . 

• courses in the curriculum. ^ 

.. " • . ' ■ ■ ' ■ . " • 

9. When a job opportunity came along in an area vhLch thi's student hadn't con- . j% 
sidered, he would quickly gather appropriate information, present himself well ^ 
and receive. and consider accepting an offer. 

10. This student would prefer a summer job aa a management trainee to a higher- " I. o 
paying technical job. 

S'" ■ " , .■ " ■ • . " ■ I ■ . ■ 

_ ^ ts a novel idea, you would ej^ect that it yould 

take this student some time to get used to the idea before he weuld consider its 

acceptance. ■ 

13. In conducting a research project, this student could be expected to depend upon 

someone else for the suggestion of the topic, definition of the problta, and 
^^9^irection. t 



Hil • You could describe this student as being bold in the way he attacks a problem. _ 
He would always be "vp" on the latest developments in his field; he would be well 
read in the current literature. f 
■ ' ■ ■ ■ ' " •fW*'- 

\<„ This student could be expected to develop a list of leveral appropriate ^opics 
*^ ... — A_ 4>..^-. . until 



for <an assigned research paper, but be unable to choose one from thelj^ 
inetiTicted to do so by his professor after the deadline had passed. -f^ 



16. The student would.be unable to extract a set of possible problems which might be 
relevant from an ill-structured,, although comprehensive description of a 
nanagemcait situation. 

IT, This student would ask questions and seek information about the influence of a 
conqjany's business beyond the confines of his own particular job. 

18. This student could be expected to make suggestions on t^e modification of deci- 
sions or their implementation to increase their acceptance by those involved. 

19. This student could te expected to l?e unreceptive to new ideas and proposals 
oven in situations ftere previous methods proved inadequate. 

20. in case discussions this student would not consider the social Implifcations of 
suggested actions. . ^ , 

21. This student wo\ild show awareness of long-range implications of current wage 
and salary decisions, in labor relations, cojnmunity relations, etc. 

22. This student would volunteer during case*discussion, but would give alternative 
recoranehdations as to two course|^^of action in a case problem. Each possible 
course 6f action would be based on an explicit, but different assumption which 
he states. , 

' * . 

2li. This student would meet a deadline in handing in a report, but i^e report would 
be below his usual standard if he also had to study for an exam >in another course 
which occurred on the same day the .report was due. , 

* ' - . • ■ . ■ ^ 

.25. This student would be well versed in relevant" geo-political, ethical, cultairal 
■ and demographic differences between the U.S. business ejivironmerit in less 
developed countries. . ' ' 

26. In an interview with a professor regarding certain personal Iqaiters coricer^ng 
' another student or faculty member, this student coullf be expected to mention the 

interview awbstance to no onci even if. pressed by his peers, t 

...» - ■ • .■ . -iiQ^ ^ > 

28. Wbu:H.d be ^tremely interested in his own progress and . in making iarovlsions to 
strengthen himself in ai^lrs? of deficiency. . . ; 

- " ' ■ ■ .■-,■>»'■"'• * \ ' 

29. "Thi^ student wyuld use- his .tl»e w|>ll, Wouljl be >able to undti^take*activitlia8 on 
shbrt notice.'^s^ , , - •;, ■ 



31. Ti»is student's •MTitt^^iac tendJ5^ be verbose, redundant, and "unnecSfciS^ly 
elaborate. . / - * ^ ^ • v . 



gj2, Wbiitd make .suggestions >*ich his teammaltes woibld usually accept dn a, slmulaflon 
■ ^j*xei^ise, research project or other class^activity. /' ^; . . . , 



3$1 Thltf^tudttnt would make unwarranted assunptlona bksed on mistaken Infomation. 

36. Usually, this student would try to get at the facts before, giving an opinion. . 

'37. This student could ]E)e eoqiected never to have a cl^^ ^^^^ what he wants to do; 

36. This student-could come out of a critical discussion of a paper h%r<)wd alnost ^ 
coispleted with ^enough ideas for several more papers. ' ^ 

-39. This student could be expected to initiate and sustain a proposal for studying 
a small business^ opp|||tunity providing there were no competing demands oni his 
time in other courses d\iring the period. 

110. Sh^a student could be expected to know ways to be suggested for gaining acceptance 
of decisions through participation of others. ' i ^ * 

111, This student could only occasionally be expected to make a point in a case* 
' discussion which w:>uld be followed up by his classmates. 

- • , , - .■ -., :>■ 

1|2. This student organizes his written reports in a dear and systematic fashion. 

ii3. This student la convinced that the only problems which merit his .attention are 
those "structured"' situations which can be solved with eJcis ting -analytical 
techniques. 

Ink' This student could be expecte(yttpt to take advantage of a^unique opporttmlty to 
consult with a local expert jjp&nneclJion with a paper he w^s preparing on. a 

difficult topic. ^ ^ ' , * ' 

• ; ■. ■ " ■ f ■ ■• ^ 

li5. Jn a diacussion on the merit of the school or major field he was studying, ^thle — 
studen-^ would back his choice objectively and without defensiveness.; 

U6. You would expect this student to comple^e-a detallW card file for material he 

had read r^ven thpiMh^it required sticking at a demanding, but unexciting task for' 
several 6lays« '^^ . ^ ' 

1*7. This student would admit .^e ne^pl to Consider the aoclal?*responsibillty on the 
part of iji company when, this Is pointed out 'by other's- during a discussion of 
re tireiijei|t policy. * > * V .V k * 

50. This student would be in a quandajy as to what to do if he fo\u«l someone else 
«|itting in his regular seat in a small class of 20 students. ^• 

- ■) ■-• ' :■ . ■ ' •• ' "^'^ ■ '-tx, . ^ 

• 51. \lf you employed this student* as reader, and' asked hiin tojevelop a list of * 

/Spedfle^lnts to be graded^^ T^ie -could be ejcpected tt^^cdta^ back to you after he . 
had read. $eyeral papers to^ask you to provide an «?)proprlate,Ilst. . A 

$2. This student ^eks situations ^ch are likely tb- yield* greatest beyneflt in 
terns of reducl^t-hls individual we^jai^ss. - . .. ^ 

, S3. This student could be expecjfed to glS^. p^pper^and syiftemf^tic attenUpn to- the 
v. various aspects of a problm, to. recognize thsr pertinence of Inrarnllbion: 
.:>/■* .vfrdm manj^ou^^ ■ . V .^ ' , . ' ■ 

' "^'-^j PuWic * i^e^^ns aspp^^s^pf jproraffems wouJ^d, .be consldered^prelevant. and night v)be 




'A, Thia- etudeAt would present material in- a confused fashion sb that his professor ^ 
. has to spend an undue amount of time. trying to pierce through to ^ihe heart of what 

he is doing: , : ' ' ' ; > . 

... ■ 1 >■ ■ • ^ 

^6. In class discussion, this student, expresses his opinions freely, but is «^asily 
persuaded to change his views when others are critical of them* , 

>8. In response to an urgent recjtost, you could expect this student to prepare f . 
broad report on a project witn.no delays for refinements even on the parts in wnicn 
he is most interested. ^ • 

)9. You would exp'ect this student to require constant prodding from classmates to 

begin work on his portion of a problem assigned to a team of three other students 
and himself. 

)1. Would expect this student to be careful to criticize action or suggested action 
rather than the individual involved. ** 

>3. This student could be .expected to be in management school only .to avoid going 
to work. 

iii. This* student would listen quietly to a discussion, contributing nothing. 



/ 



Coiald be expected to take charge of a discussion\group, answer questions, and 
act' in a mature manner. 



S6. Would be able.^.to direct, command .respect, and provide constructive suggestions. 

37. This student would be a very effective speaker and would get his ideas over \*ell 
to his audience. *^He could be expected to have an interesting and forceful way ^ 
of presenting ideas. ^ . 

58. This student would be able to assess the limitations of theories and principles 
frpm a discipline when they are applied to a management problem. , 

70. This student could be expected to cringe at the anritincement of a field trip, to 
grimace a* the mention of a group project. , - 

71. This studeat' would' be able to integrate production, marketing, and finance view- 
* points in a^' case problem involving a company diversification decisison, but . 

woiild be unable to- incorporate relevant government policy, social factors, and 
exdgeneous technological trends. 

' - ■ ' 

72. ' This stucite'nt speaks in a monotone in class and geherally gives the ljii?)ressiyi of « 
' not beingj interested in the subject. 

rli. This student's written work would be interesting and easily read. ' - 

In writir^g a. term paper, this strident would present one point of view, but 
would not follow obvious leads to present a balanced report having \t*o other , 
points of view represented. ^ • . • . .4 

'6.' This, studeii^ir could be expected to do independent readifng.or research to fcheek 

the validity of interpretations or evaluations which differ from his instructor's 
(^classmates.'; ' ' • 



77. In a class discussion regarding a procedural issue vhich had been causing a ^ 
problein, this student could be expected to offe^- an alternative procedure with 
presumptive merit without incurring the ire of anyone. 

78. In writing research reports, this student might disi^e^^ the background and 
interests of his readers, and submit reports which are either not understandable 
or inappropriately elementary. 

79. When required to prepare an assignment on a topic of his Own choosing, this 
student would require an instructor's help in finding a topic and later on has 
to be checked on to see that job gets done. \ ' 

80. . In business games or group learning efforts this student could be expected 

to evaluate the problem independentlj^ and tak^g|he lead in suggesting metljods of 
solution. • . i 

81. This student seldom misses deadlines. 

82. This student would be handicapped by a "i)lack and white" approach to all 
problems, . 

83. In recommending a" course of action, this student would demonstrate awareness 

of all relevant dimensions of the problem enviornment, but. would fail to conoider 
whether his proposal was compatible with the individual responsible for imple^ 
menting his suggestion. 

81i. °0n some cases, this student could not be expected to volunteer discussion, on 
others" he could. This seems to be due to a difference in interest rather than 
in preparation. _ - 

8$. T/his student would be congehial and pleasant, outgoing and spoBtaneous. - . 

86. ^ When he makes a comment, it often could be expected to influence or change the 

cou^e of discussion. ■ . ' ^ 

/ \ ' ' ' ■ * ' 

87. This student could nof be expected to ask probing question^, nor to challenge 

statements made. in groiBp discussions or s^ninars, nor to attenpt to defend his 
own position. 1- ^ 

89." JThis student would be' at a -loss if the rrfom he was assignfed f gr a discussion 
jgroup was locked, ' ^. ' 

91. In a ciass discussion, this ''student usually comes up with most of the ifiajor 
^' points, necessary for- solution of a case, but he doesn't organize them well. 



93. In stressful circumstances this student, wbuld beSjmable to decide on even 
routine and 'trivial things such as jAiat.to order for lunch.' . ^ v 

95. When applying to g!faduate schools, this studfent would be expected to consider 
business schools. r - . ; / . / 

96. In, ill-defined "qualitative'! Isituations, this student would use approaches In 
structuring problems which do not fit available ' techniques for rigorous solutions . ' 
He coxlU delineate a useful way of viewing the problem, and where, theiy, fail to 

Q account Tor imjiortant problem characteristics* 



97. This student would express himself well in recitations and comments in class; 
his points would be clear and his presentation convincing. Classmates would 
pay close attention to what he says. . 

98. Although the student might be sensitive to environmental forces affecting the 
■ way his performance is perceived by otl\ers> he would fail to assign prioritiea 

to different environmental forces in order to determine adaptive behavior. 

99. You would expect this student to accept an assignment and work at it continually 
until comp3.etion. . 

00. This student's work would be obscure and full ^f mistakes, incomplete sen- 
tences and misspellings. It would be almost Impossible to follow the line of 
thought^ 

01, This student would operate strictly on intuition^ being unable to give reasons 
for hunches. 

,02, This student is a slob, habitually unshaven .and unbathed to the obvious embar- 
- rassment and discomfort of .his associates. 

,03. This student systematically analyses local situations and experiences, in itiloh 
he is involved in sei^ch of things he can learr\>hat will help him Ijnporve 
his future performance.^ 

OU. This student oWd be expected to miscalculate the willingness of other 

students and the faculty to assist him in his work and. their interest in it. , 

,07. If confronted with strong opposition to a.^ decision of his lAiich deviated from 
' conventional practices this sttident would stick to his position, being willing 
to accept the risk because of the possibility of obtaining an above average • ' 

profit. : * ' 

.. { 

,08. This student would talk freely but say nothing sensible. He could be expected 
, to use big words, often erroneously. He would be almost impossible to follow. 

. ■ ' . > 

,09,' You would exMt assigned reading to be completed, but would not expect this 
student %o uSfertake extensive reading beyond that assigned in^ an areai. 

10. When asked unexpectedly about tlie characteristics of .a procedure with which tie 

shcJuld be acquainted, this student could be expected to be evasive as a reflection 
on his ignqrance in this area. 

Vlhen, in a discussion group of $ students, this' student finds that he and 
another student are in the minority and are subjected to sarcasm by the majority, 
he could be expected to stick to the point of his argument and not become 
defensive. ' * • - y 

12. Thlq student would be expected to'stiggest something no one else haff thought of 
in a redtaticta. ^ • ■ 

. ' / ■ . . . ■ 

13. During a case discussion, this student would speak up to argue against a course . 
of action a classmate has 'given, but he would not advance an alternative course 
of action. ' • 

ERIC • • ^ 
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iUU. This etudent could be expected to give -his undivided attenti'on to even the 
rather uninspir^ conimehte by a classmate. . \^ 

115. This sttident covild be expected to show i)atalence and willingness to explain a 
point to a less competent classmate. 

116. This student could be expected to present a poorly organised report and to 
explain its lack of quality on the basis of the short notice given for its 
preparation. 

117. This student coixld be expected to detect inconsistencies in the position taken 
by a professor in a critical, significant classroom lecture. ^ 

118. This student covad be expected to know each his instmictors fully— their 
grading practices, standards, idiosyncracies, expectations and preferetices. 

119 • You might expect this student to be late in handing in a report because he 

had not started preparing in time. even though the report had been assigned ^ 
several weeks in advance. 

120. This student would trik reasonably wjll in class although he would sometimes 
have^ trouble expressing himself; The class woTild sometimes find him hard to 
follow and occasionally his position on an issue would be misunderst6od. 

121. In a library reseerch paper, you coxild expect this student to find a few 
references, but not to puyaUe the literature sufficiently to find the most 

pertinent material. 

• • ' * " 

125. Would be a "take-charge" man for his team in a simulation zeroise or research 
project. . * 

' 126. This student CQjlLd be ejqpected to try even harder >rfien he found that ^a problem 
of supposed^v/i^ difficulty resisted all initial attempts to resolve it. 

127. This swdent ^wSSM prefer an easy course with an easy grade to^ tou|ji but , ^ 
useful courses. , v • - ' 

f . 

128. - This student will willingly.. "cha^r" a conlWiittee, but only if it is composed 

of a very few other^.rtembers on 'wfcbm h© can'impose the. menial tasks while he 
completes the more intricate functions as a one-man team. 

129. This student would j^tgree to help with some task if asked, but would fftd some 
exc^ise not to help f of very I6ng. 

/■ ■ ' " *- , " . 

130. After a particularly good lectiire, you could expect this student to be . 
waiting for" you outside your classroom with to invitation to Join hija and 
others for coffee and i continuation of your talk. ' / 

131. This student would be interested enough to r^ad the Wall .Street Journal, and 
other management literature • " V 

132^ This student could bp expected to be' active in a student managen)ent organization. 

133. This stwdent might deliberately flijnk a wath qualifying exam in order to take \ 
. « eouree in which he will get good gradeS. r . 

er|c ' ' " ^ 



r 
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3JU. If aseigned as a teaching, assistant to trac^^own 20 reierencAa in marketing, 
you would a^qject this student to return in/a week with the Job completed after 
doing extensive dftective work. ^ 

136. This student could be expected to master concepts in individual fields, but not 
to recognize essential differences and similarities in approaches tOa problems 
suggesteii by each field. 

137. This student could be expected to be late for classes, to sprawl in the bAck 
of the classroom, and to talk out of turn to other atudents during clase. 

138. This student would know how to give and take, to compromise, and to work with 
others for the bei»efit of the group. 

139. Thfs student waits 'til someone else has suggested a decision before committing 
himself, but defends his position wbll. 



lliO. This student would habitually break problems into parts. 

lla. This student would have s\if ficient information about a specific procedure that 
he would be consulted b^ others in his field. 

IU2. After a presentation by men with higher professional stature, you would expect 
this student to successfully challenge information and opinions concemlz^ a 
particular operation within a conqpany. 

« ■■■ ^ . ' 

lliii. This student might plan and organize a used book exchange to the point thatklt 
proves a financial profit to him. J 

3Ji6. IMs student would be able to "describe i problem solving technique using the 

language of iihe textbook, but would fail t6 apply it qprrectlj^ to data presented 
in a.forilnft he had not seen before. 

.# .. 

1U7. This person might voluntarily teach a night school course in a subject somewhat 
outside his majoi: field in an effort to broaden his knowledge and teaching 
e:qperience. 

IU8. On offering criticisms on "a sdcond draft of this student's paper, you could 

expect him to make only a few minor changes, e^en though many more adjustments 
might be needed. 

' ■ -' ■ -"'"^ * ■ ■ ' ' ' ■ 

You would expect this student ito find sources of information beyond those 
suggested initially by the professor for a Jbopic in a graduate' seminar. 

This ^tudeht could be esqpected to block <Jn exams, especially those requiring 
opinions. and evaluation of giyein^ternatives. 

In a class discussion regarding a probleifbatic procedural issue , this student 
would offer an. alternative ^procedure in such a way as might offend others^ 
particularly tjiose who had "proposed the trtmblesome procedure* 

l52a ThiJ^tudent would be well prepared on an assignment to be dlscusse 
cla^s even though he had handed^^lfT a report in another class the s^ 
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After advancing a future action in a case discussion, thii student would give 
in to the counter w-guments of four other students even though their arguments 
had no superiority other than social pressure. P \ 

This student is of ten late for meetings^th his classmates although others in 
■ similar circumstances don't find it difficult to.be on time. 

155. Given limited time and resources, this student would seek basic working knowledge 
in a variety of fields rather than intensive and total mastery of a single 
specialized facet of managerial activity. 

156. This student, as the orgM^zer of a pdlitical action group, would have thiT 
ability to make stuffing envelopes an enjoyable task. He is not above partici- 
pating in a program of action at any level, no matter how menial the task. 

157. When discussing a case^ concerning a Negro,, this student might try to gain 
support for his opinioft that Negroes are.somewhat laaier than whites. 

Should this student find himself in need of certain information or ^erstanding 

not provided by the present curriculum, you would expect him to go to the Dean 

without prompting from others to propose that a spyial seminar or course be 
organized. " 

159. When a professor explains the objectives, content,, and methods of several courses 
vhlch this student Is considering, this student would not^ be able to decide on 
registering even after studying the syllabi and talking with several students 
idio had taken the courses. ■ zi " 

160. During his last year of graduate work this student would select a list of ^ 
companies he regards as sound, send them a description of his interests and 
qualifications, and propose that each company hire him to introduce or enlarge 
services or procedures that are his specialty. • 

' • • ■ . 

161. In a typical "curriculum, of several separate but related courses, this student 
cotad be expected to choose his topics and select his reference sourced for a 
current paper in a way calculated to assist him in other course assignments. 

162. When faced with a choice of elective courses, this student always picks one 

' Olosely related in subject area to courses in which he previously has received 
high grades. 

16U. This student could be expected to help slower students voluntarily. He would 
hot, however, be motivated by self-aggrandizement. 

■ s ■ < . 

165. Shortly after arriving on campus this student could be expected to be familiar 
c' with the rules, locm customs, mores and social structure. 

166. Would attempt to dominate others by imparting to them a sense of subordination. 

167. Judging from his withdrawn b^avior in class, you *ould expect this student 
night not be able to hold the attention of a small group even in a discussion 
at coffee. 

168. In grJap assignments, "this student volunteers to do that part of the job which 
he can do best, instead of seeking the task which will enable him to learn the r- 

.9^- most. 
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L72. If in a claas of UO, this student prtsente a different point of view and is 
. booed, hissed, or laughed at, he would be calm in defending hie position. 

L73. . Ihli.student would know the first Qames of all the people with whom works* 

L7li. In class discussion, this atudent would l?e able to make an effective presentation 
when told to assume circumstances of a case are radically different from thMe 
of actual cases. - 

This student would be concerned mainly with short-range profit or irtmediate 
benefits to a company or department. 

You would expect this student to be friendly and easily approached by freshmen 
seeking information on graduate work in business school. 

Before the end of the spring eemfteter, .this student could be eaqpected to find 
out about his academic program for the ne;>ct year in oHex* that he might take 
any steps during the summer necessary to be ready for the courses. 

This student could be expected to be really interested in engineering, but would 
think he could make more money by goihg to management school. 

When asked to preeent a paper in a class or seminar on short notice, this student 
could be wocted to overlook several routine details such as having a slide 
projector available if needed, or in getting tabular material to a secretary 
in tim? for duplication. 

This student wduld be sensitive to others' needs to participate and would not 
dominate a ^dscussion. " ' ^ . . ' 

Th±^6 atudent could be expected to recognize and allow for the fact that maiy 
consumers feel an essential objective of business is to provide a real service. 

This student cotad be expected to apologize before asking a professor to repeat 
a statement he had not heard correctly. 

This student could be expected to take advantage of every opportunity to be - 
productively engaged in study or other self -improvement even when riding on 
a subway or waiting in line in a cafeteria. 

If a well known authority on tax law had been invited to speak to your class, 
you would expect this student to arrive early for the lectiire with a few good 
questions already in mind for the discussion period. 

This student would almost never recite in class and when called upon, would \» 
almost inarticulate. Ideas would have to be dragged from hjm with very pointed 
questions. 

This student would hoard reserve books in the library. 

This student would keep informed about cxirrent events and woiad see their 
relevance to class discussions. 

189. TW.a student could be expected to consider timing and coordination of events 
in solving a specified problem in marketing. 
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190. This atudent could be expeot'od to go to the placement office to inquire about 
Job opportunitiea before moet atudenta, in order to *voi|| the leat Kdnute ruah 
for eppointments. 

191. Without aiy apecific euggeation by anyone, thie atudent could be expec^d to 
nako an, appointment to diacuae a tjueation he h4a about a point a profeaaor made 
in a lectture. - ' 

192; If he felt the situation warranted it, this student might break minor rules. 
' For example, he would hand in a handwritten report when a typed report was 
retjttired. 

195. this atudent would inconveajLence professors and staff by taking their tine for 
problems which, with a iitne effort, he could resolve by himself. 

19li. 1W.S atudent could be expected to find his own thesis or tartii project auibj^cti 
without the help of a faculty member, and proceed in the initial atagea of the^ 
atudy without ai}ecific guidance from a faculty member. ^ ■■ ^ 

*■ - ., 

19^. Thia atudent would care enough about a new peraon to show him where to get 

supplies or to sit down and talk to him understandingly about specific problema. 

■ 196. Thla atudent ml^tijiegin discussing a problem in the middle so that the 

interested patties have a tough time understanding it. He doesn't fully explain 
trtiat he is talking about. 

197. In a business game, this student could be expected to lay out tasks for team 

members, to make sure different contingencies were foreseen and to plan simulated 
coii4>any operations several moves ahead. 

201. This student would be able to isolate a set of issues when-confronted with a 
case' write-up, but would fail to define reasonable criteria for comparing the 
merita of alternative proposals. 

202. If unable to solve a problem in probability theory by applica,tion of fonmilaa 
discussed in class, you would expect thia atudent to give up after hfPt an hour, 
even though he could obviously solve the problem by the inelegant and tedious 

> method of enumeration. 

203. This students educational pursuits will probably end the day he gr<i^iuates. 

" 20U« This student could be expected to seek out another student without trans- 
^ . portation to offer to take him home although it was several miles out x?f the way. 

206. When asked to fill in temporarily on a business game team, this atudent would 
become intrigued and would enliven the aeaaiona with his interest. 

206. When conaidering a new floor layout in a production problon, this student could 
be eoiMCted to overlook an important detail like a means for removing the 
finished product from the work area. - 

210. On receiving a low grade on a test, this student asks the professor to explain 
, the formulation of a better solution and to point out. the weaknesses in his 
4 approach. He fails, however, to apply this explanation to a new situation to 
O v test his understanding. 



212. When called upon thla student would restate the facts of a case, but 
wouldn't decide on a course of action. Instead, he would say that more facts 
are needed to make a decision* 

213. In organialng students to carry out a class project, this student is unable 
to assign priorities among subtaaks which reflect their relative importance 
to the success of the endeavor. 

2lli. This student's work sparkles and he displays an active interest in each 
situation in which he participates. 

21$. You would not expect this studen^ to volunteer in class discussion, though - 
he might be well-prepared wheh called on. 

216. This student could be expected to be involved in several graduate student 
extracurricular activities, to play an active part in graduate social and 
athletic affairs, while pursuing his academic WJrk energetically and auditing 

'■ or takin^extra courses for credit. 

217. In a seminar involving a computer soljmon oJ^ a business game which is 
unexpected and unreasonable by convetttjJonal st^dards, this student would 
undertake a detailed, step^-by-step review of the stages of the program. 

218. This student begins a research project with an "I want to find out,..." 
attitude as opposed to an "I want to prove thus and so" attitude. ■ 

219. This student could be expected to consider schools of business as we;kl as 
other professional schools when- applying for graduate study. y 

221. This student would rely on faculty to make program decisions for him. 

222. You would not expect this student to see}c a challenging problem on his own* 

223# This student could be expected to stick with pedesttrian solutions Which 
represent only old and well-tried ways of doing things • 

22U» IMs student would probably look four or more years ahead, 

225. Classmates would be likely tob respect his views in class discussions. 

227 • This student would be \inabie to tolerate ambiguous situations where the 
outcome of any course of action is uncertain. 

228. This student would be able to determine logical reasons both pro and con 
for a certain action r^^pirdless of his own personal opinion. 

This student would not be very serious about man^ement as a career, but 
would see it as a means to an end for him. 

As chairman of a group activity where individual performance is Judged on 
the basi^ of total group performance, this student would ass\ime responsibility 
for failures, even thoiigh they can be traced to the ineptness of anothefr 
member of the group* 



.A13- 



231. Wo\ild expect this student to take aooount of inpllcatlon of eotlons for other 
parte of an organisation and for others external to an organisation. 

232. Hiis student would fotmulate reasoned reoomnendations for action in a variety 
of Qiiuations. However, he would insist on completing most tasks hinself and 
would be unwilling to rely on the competences of others. 

233. You would exiMTdt this student to resist suggestions for changes while failing 
to explore the validity of his position. 

23U« After the instructor has begun a case diacupaion with a question, th9 student 

^ould be expected to respond bj suggesting an entirely different, but defensible 
question as a better way to begin analysing the case. 

235t This student could be eaqpected to be constantly on the look out Tor fndicationa 
of his standing in the eyes of the f acu3.ty. 3^ 

236. Thib s^dQnt might propose a research idea which requires a substantial amount 
of correspondence to many companies and irtiich runs over trjoi one, term to the 
nexte He would keep up hi.s interest and follow up to get <jdep^nt percent of 
retume ' ^ 

238e This student ><s written work wnM be so brief it would fail to convince* Long 
Jumps from one idea to anotheP^pild makb his reasoning hard to follow. 



K 



239. This student could be expected To be in Business school only because of. his 
parents* insistence. 

2l|0. This student would be able not only to evaluate and select from relevant 

altermtivMr fbr solving a problem^ bulk also would structure a problem in a 
way which would lead to the generation and testing of new^ alterriatives boyond 
those suggested \xj particular analytical tools. ^ 

2UI. This student can be expected to display a healthy skepticism about existing 

procedures and traditions, and to make constructive suggestions for improving 
operating characteristics. ^ 

2112. This student speaks up sharply in a iiigher pitched voice than usual when 
discussion hits an issue about idiich he obviously has special knowledge « 

2113. This student would be e:q>ected to raise the question of responsibility of 
business to provide Jobs for employees displaced by technological developments* 

2lil|. When faced with situations lAiere organizational values are in conflict with 
his own, this student would withdraw from participation rather than attMipt 
working from within the group toward modification of the group's objectives.' 

2li5. This student would write his papers in such a way Uiat each assignment appears 
to be a challenge he has eagerly accepted. It is a pleasure to read his reports 
and one infers that he has gotten a kick out of writing them. 

Zhl* the imstructor was delayed fi^r a case discussion, this student would be 
likely to get a discussion s'^ted. 



2U6. You could count on thla student to organiae and keep |l8 discussion group 
going. 

2$0. Oooasionally this atudent would be sarcastic to those who ask him for help. 

■ ■ " ■ . I 

251. In an area In which he is having* difficulty, this student could be ejected 

to prepare an outline of concepts and to work out problems as far as he could 
go in an effort to pin down specific points of his weakness, and to discuss 
thla effort with the^ professor, asking questions until he is confident that • 
he understands enough to overcome his difficulty. / 

252. This student would be unable to artic\ilate any reasoned or informed viewpoints 
on subjects other than th^se required in his business curriculum. 

253. In outlining the issues involved in a case problem per-taining to introducUon 
of a new manufacturing process, this student would aasuros that manufacturing 
engineering and engineering ecbnomy variables are the only relevant factors. 

25U. This student could be expected to apply for admission to business schools only 
after being refused admission to other schools. y 

255. This student Would be unable to manipulate and obtain* a quantitative solution 
using computational formulas which are specified as relevant to a given problem. 

256. This student woxad enjoy studying and observing the problems arising in 
connection with a major change in production methods, .but he would not want 
to be involved actively in having to bring about the change. 

257. This atudent could be expdcted to select a tern paper iro^vlng an ill-defined 
and unsolved problem in an area with »*iich he was least familiar i.n an attempt 
to learn more. ^ ( ' # . 

258. This student would be able to discuss issues of a case well, but wouia find 
it hard to answer questions based upon changed conditions in the case. 

259. As program chairman, this student could be expected to manage arrangements 
for enlisting a m4in speaker for a special class lecture reasonably well, 
but he would probably omit one or two details which would have to be. handled 
by inqprovisatlon. 

262. This student mi^t express himself orally in an adequate manner, but wo\ild lack 
clarity in the organization and meaning of his written work. 

263. This student's oral and written e^qpresslons both are awkward and unclear. 
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Instruotlons for Jvfdgca 




» 

lou hav* b««n ««k»d to.««rve aa a Judga In a rataaroh affOTt b^lag 
eoaduotad at E.T.S. at tha raquaat of tha Policy Coindttaf of tha Admlaaion 
Taat for Oraduata Study la Bualnaaa. lha objective of thlt %iork ia to daralop 
a sat of ratine aoalaa to aupplaBMnt aoad«mic gradaa aa criteria of atudwit 
parfMaanoarTo oweona tha "halo affact" iihich haa plaguad raf^^oh 
ma and to BMkka tha aoalaa aa aj^cit at poaalbla, aaoh ^cala ii f balni •^^ortA 
S^baS^bla bahavior... Thi. rtgiiraa that ym obtain bilharioral 
oowatfiii J>Kliaa trOl ama do, llPffct, iUuitrata tha- qualitlaa In quaation 
■SSdSaS a^STbn how' Such of tha quanty/ la illustrated; .Accordingly, nould you 
piaaaa taka tha follovdng atapa^ . . ' \ 

V ' 1, RMul aach of tHa'f«aaral 8tat«nanta daflnlng. high, nadii», and 
lavala of aach of tha finean'qua:iitia5.$alactad. QlTa 

tha intaodad ditftlnctloDa aaon^ tha »iill^. <lt is racognUad, inddantally, 
tBat avoTona my not agraa'that alJ^f tha qualitlaa ara daairabla. At tW.a 
ataga of tha raaaarch, *a ar« nora^oncamad ultK-ful^^ dascription than 
•valuation.) • ' \ . 

2. Raad aaoh of tha axunpl^ which ape r^?ro4ucad on tha 3x5 carda. ^ 
Thaaa ara intandad to illuatrata aooa la*al of a' quality. Slnca thf pwrtiouO^ ^ 
^T^pyL, «u ha^a wara randoaOy salactad from a larger pool, 3Pgu «ay not h^ ^ 
an axaanLa of avary efuality in your aanpla. Tou should, ho*#BirtP', aaaign avwy - , 
•xamlato a particular quality.' WWta in tha lettars repraaanting tha onr 
ouaSty yott faS, la baat rapraeantad by tha axaiapla. Tou may find it h^pful 
flrat to .aort tha aawles, and than to aaaign acale valuaa to all tha itwaa . 
within a givm quality.' 

3 . Record the acale value you believe should be assigned to the ^ 
faHcaimle to indicate the amount of the quality it represents. Refer to the anchor 
statamanta provided fo? each scale, ^f yOu believe a particular exm^iLe eaftiodiee 
only a — anounfe of the quality concerned, it should be given a low rating,^ 
p^pa .00 or .50. Conversely, if you believe it illustrates ahlgh degree of 
the goiaity it should be placed at the high end of the scale ^ Tir Wi^^^^f^ 
it«B on thto degree of a quality Illustrated, without regard to whethtt* you feel 
the particular behavior in the exsa^jle^is desirable or not. 

Suggeated reviaiona designed to clarify what is^llustraUd by • Pfrtic 
ular exunle are waleoilBd. However, ale ""^ rtf^» ^"t" liidainants nonoerning the 

' 14 4^ mrsA *L\im vmluA of tho exuBDle in terms of the on giffT 

iriginAl item can thib be 



comiled. After completing your ;i.udgMnt of the. Original, iwp, T ffl r aoora 
aoggastad ravisiowf^ and your JudffMnta aaaoolatad with rarlaaq e « <H > i a . 

Fleaae keep Ih mind that in order for the JudffMnts to tS» easeful they 
mat be oarafuUy 4ade. Hastily made judgments may qg|3;^* confound the result*. 

lhank you veoby much. We greatly apparecUte your hmlp. . . 
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RATIN& J5CAI£S TPR GRADUATE STUDENTS 
'j» SCftOOI^ OP BUSINESS AND PUBLIC AIiNINIS!i;RATIOir 




Pz«par6cl }Mut the Direotloa of f^ollcj Ccnnlttee 

' of the ' ; ,^ 

. Admlssictti Teat for (^r«dvi&te ,3tudar in Buslhess 
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E4ucatiflnal Testing Service, Princetbti, Hew Jersey 



\ ; 




Basic long-ranj^e goal is to parti- 
cipate in nahagioneDt . Conmitted to 
assximing managerial rsspiansibJJlty* 



— > 2.00 



1.75 



1,50 



1.25 



Might serve as a consultant on , 
problems of management but primarily 
Interested in technique, and in 
studying management as a scene *ot 
movents relevant to general research 
interests. i ; 



■> 1.00 



0.75- 



Would ^ng^ge in business activities 
only as a means to an end and likely 
gm(^ild enter this field as a. •second . 
Dice.»» ■'■ ■ ■• .i.:.; ■ • ■ ' •- 



T0.50 



0.25 



.0.00 



Able to work tWo^^^ otla§r^yih»te 
^tiibtt|^o|i of oflher grouj? or or&Mi» 

Wi^tionk WiXlihgN<o accept me^UM 
of pQi^aoaal perf ori^^ , 
on taov mucb he 16 succeftsfi^ In ^ttlng 

; other people to contribute to programs 
of abtioh. \Accept8 rj*^ for 
perf oxmaoce oil other^^/^^ Abie In f a 
cilltating 8ii4)t^^*imction%t of groups 
and organjlKatic 



Hote : I^ianning Tor Inplemen^^ Is; 
^ covered, bj^ the scale vlth that 
" tl^, 

i i ■ 



Moderately successful in gett: 
work done' through others . May^be 
some reli^tetance to delegate re- 
sponsibility. 



. : .\ . - — T" 

"'probably^ is unable to delegate 
/responsibility and effectively 
rdinate worVc of others. 
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3tudent particularly alert to op- 
l^rtuDitie'8 to broaden bis coiilpeteui . 
and insight beyond prescrlM assip 
Bi^t8«^ ficis sense of direction and 
puii)68'e ,- a veil thought - out and real- 
'istic. plan for reali^ng his edu- 
cational and career gop and for 
testing and modifying tW. ViUing 
to .ipofitpone gratifid^itions./ 



Student moderately alert to oppor- , 
tunitles forieaniing. May not 
iitiivB fully thought* out career devclop- 
tent .plan.' • Occaalonally may faUe > 
special steps to strengthen his proV 
fesslonal preparation. 



Student only undertakes prescribed 
assignments and courses vlthln nar- 
rowly defined field of study? Chooses 
projects and courses in areas of pre- 
viously demonstrated strength and 
competence. /May do noihliog to 
develop a career plan of 4o. Implement 
•<j:'*,ever plans he has. 

ERjc ; 
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t 



. ' ' This student could be, expected to select a tem ' ■ 
I'THpaper' involving an lU-defined at|d unsolved problem in an 
. . .area vith, which he was least familiar in an attempt. . . 
^A-toiearnjiore. 'v ■ ■ .. /: , V 

h-IMs student might volunwUy teach a night school course 
1.^ " . in a subject siii^ outside his ioajor Jield in an , 

effoH to ir^en his khovledge and teipjig , . ; ' ' ' 
experierice.' V ■ i \ ' , ' . 



1.25 



I 

o 



l.OOfihis student would read the Wall Street Journal and ftther\ 
manageisenV literature bsybnd what^vas required by 
class, asSigjiiients.'^ ' ' ' • ^ 

■ . . ' 

O'JMMs student would talce a sumei' job' as a knagement 
trainee rather than a higher paying tephnical job, 
" if a^ed tQ do so by a professor. « . 



0.50 



0.?5 



In group assignments, this student volunteers, to do 
-that pan of the job which ha can do best instead of seek-, 
'ing the task which will eifable JiiA to learn the most, 

-This student night deliberately, flunk a math qualifying ' 
exam in order to take a course in which he. wlH get 



O.OO^This student's educatlcoal pursuits will probably 
end the day he graduates. 



r 



DenoDStrates capftdty for judging 
souDdly and dealing broadly with faats 
and 'tto'ifl^icatXoDS' of aetiona; es- 
pecially 1q tbelr practlcd relations 
to pbllticid; sodal/and econcnic cop< 
dltionsv Has a broad interest aod; 
bacHground of InfomaUon and Is ajfare 
of the social InpUcauOfi of buslpess 
activities. 



Note : Also see the Techni(^ Xhowledige 
.scale. 



Is fairly knowledgeable' outside tihq 
confines of business but ielates his 
outside knovle^ to his business' 
decisions and actions -only' if stimu- 
lated 'to do so.. ' ' ' • 



I 



■ V- 




Confines his Interest to the, organi- 
zation of technical knowledge about 
business. Is insensitive to possible 
broader, social consequences of busl-^ 
nesB actions* 



Ihls student Vould show awareness of long-range 
ijiilicatlons of current wage and saliuy decisions, 
^iji labor relations, conounlty relations^ stck • 



frThis student would kBep inforined about current events 
1.^' and would see their relevance to 61ass discussion. 



1.00 



-This student would adoiit the need to consider the social 
responsibility on the part of a company when this is 
pointed out by others during a discussion of retire- 
ment policy. , 

* ■ ■: ' 



0.75 



'^i student would be able to integraterproduction, 
Oi^O > marketing, and finance Hewpoints ill a (^86 problk 
involving a ccDpany diversification decision,, but 
' would, be unable to incorporate relevant govemmejt 
—policy, social factors, and exogenous technological ' 

0 25 

^In outlining^ issues involved in a case' pertaining' ti ', 
IhtrcjEctloH of a new manufacturing process, this 
student would assume that mafiufacturing engineering 
-^0.00 and mgineering economy are the only rel^t factors. 



V, 



hi 

i 



TECHHICAL PKWJSDCaE, 



Thoroughly faaillir with the neeessuy 
ttclnletl infonation at veil as baaii 
;j4i|fOi^ iihieh' speelfle ln| 
foniitigni' relevant to lartlcular ao- 
iilclticn idthin hla flel*. ' ^ 



■t. . ■ 

■^2,00 



Note: Also see the Perspective Scale ^ 

and the Arobln Analyses Ability Jeale. 



^•p4-;ll}lB student would hav* sufficient Moraatlofi aboift.a ' 
- ^ specific pr^edurb that he 'would be consulted k 
other students as an expert 'in the field. -'^i 



r 



Possesses essential lechnical, infor- 
naticn but nay be deficient in Itnow- 
ledge of basic principles required 
fpr technical problns without pre- 
scribed solutions. 



\VKf spotty teohnical knowledge or. . 
^knowledge nitrieted to oft]^ the lost 
„_,y _,ioo teehnlcal infoniaticn. ' 



1.50 



1.23 



■^1,00 



/0.75 



0.50 



^This studeht Vould be able to manipulate correctly a' 
BiatheiDatical procedure, but would not be able to ' 
state the najor assuniptione on which the method is 
based. 



0.25 



-This student would be unable to manipulate and obtain ' 
a quantitatlva aoktion ^s'ing coBq;«tational fonnilas 
which are spedfied aa relevant to a given problem. 



^0.00 



•.7S 




^^. ' i ' . .■".-.-.4- ; 



BtxM omfi, i«lf-coDfidence, and 
tonstiutey is the 'face of difficulty. 
Is vllling to ^ke decislms and ae- 
sune 'reBpoDSi))il!ty for pcMfslble risk 
aasoclated vlth uQcertain Outlccoes. 
Halntaina equanimity under ^tWa. . 
viuing to stick to an wimi de- 
cision in the absance of bnber alter- 
natives. Resilieiit to setbacksi 



|Jote: 



Alao see Probln Analysis 
Abilltyi >(liich is Uo be dis- 
tinguiahed fm thj) jpresent' 
sealej V*'^ 



SoDetines displays reluptance and . ^ 
uneasiness vltb decisions and^ cooi^ 
' fldtne'nts where there Js *Tlsk and ^ 
uncertainty. . iJaaally^calm, con- ^- 
trolled,' «tad self -confident but ' , 
jby become^uncisrtain and coi^used 
uMe^ stress, ' , 



Procrakttoitesirthe face of un- 
certainty until forced to decide. ; 
Fearful of failure and rtjectlon '•' 
and frequently disabled by aiixiety. ; 
Capricious and unpredictable i 
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^ 2;0O4>If fcoofronted with strong opposition to 'a decision of hla 
*/ 'Whic]} (teviated fron conventional practlcea. this 
\ student would stick 'to his position. . ^ 



Ij^Jf, in a discussion group of 7 or 8 students, this student^ 
' found iiiJBse^ on the mijiorlty side and' subject to. the 
' • .saroasn of the majbrity,' you could expect. Mb to stick 
ioy the point of his argimit without becQ^ 

1.50 ' , . - • . 



1.25 



r 



^-T^ LOO 



is 



I 

.0 

0 

I 



This student waits" until scyneone else -has kjteested a 
. decision befqrp coiklUln|^hiffi8elf,'but|B de^ds 
Mi position well. ' ^ — Q ' " 

'^in cla^s discussion^ this/stJudent exprassW 'bis opMons 
jsely, but is easily persuaded change his viewl" . ' 
ien others are critical of the^L . 7 

0.50i*^tJhen called upon) this; student. ifould restate tl^e facts'JJt. 
a- case,/ but Wbuldiot decide on a fourse ;bf 'actiwi. H 
Mead,, he wotELd sarbhat npre facts are needejl to' v 
V'Jake^ 5f ' ■ ' 



- : ' In stressful clrcuilistanc A, this student would ^. ^ • 
^\ unabls to decide on even routine 'and trivial 'tEingH 
<jh-«uch*as what to order for Jpich, - 



o.op' ... 



I- 



; "4 




Apprttriit^^ ftNigns prloritlai to 
audfie use of rMoureal^ oatirlil^ 
•nd>r8onnel. Antlcipitei chiges 
in the envlroMMJit. . Schadulei con- 
currwt «o4 aeqfctUl MtivitieB 
i« n9e^iM$ toW dMdHnei. \ 
Pliiuiing QonMrns both tm^^)- \ 
ttiks ind pivp'br oipgirdMiional ^ 
work h« i» Involved in. * » / 

■ — 



'■ . • 

Thil 8{udert4nW be wll pJ^pared on an aealgniMiit 
L:75<"to*be diecuaaed In yo«r ckaa even though he h«i, handed 
' -In a «port' Ifl another claaa the aaoe 



-Me student aeldoot nleaea deadlines. 



•Mote! Alao aee ^Im Analjfala Ability 



1.50 



1.25 



Plaiia for large aepenta of a .taak 
but limited in ability to antici- 
and provide for leaa Moue 
requiranenta. 



As progran chdnoBn, thle etudent could be^cpeoted 
I to manage arringeoeiite for ttiliating a main[ apeaker 

— 1.004-for a apecial claaii lecture jeaaonably well, but he .i^uld 
' k proliably (Mi one or l^det^lla which would h^ve to , 

. li be handled by improyieation. 



0. 



0.50 



~ Vhen asked to prea^ a paper in' a claas or seminar, 
'^4-thi8 student eovld be,e:^ed to overlook aeveral routine 
- details such as having a slide projector avidlable'lf 
needed; or in getting tabular material to a secretary 
in tine for duplication, , 



0.25 



tMR^iriorltiei. Xoves^ 
^ mothir with no regwd 



toanlA' 



bleto 



.v^Heiiiti fliiwf neisT 



■ '.J * ' 

l^ioa iiii# expect this student to be Ute.in handing in a 
. ^ ■ report had not started preparing in tlai 

0.00'*.' iwn.^ 

> weeks in advance. 




7' 



Both tltt« ttd TVtal eonnioi^ 
tioi IN elMr iMA iNolN. Not 
vMt tiMil nor tndulr liigthr 




\ 



Either wltt« or viital ooonnic^ 
tloh is VMk or both ire Bcnetines 
leu thtn oleir end predM. Per-, 
hipe both ire genenUy of only 
nodente qoility. 



iali H 




This Btudent muld eoqpreis himself wll In written work, and . 
I also In oooBents in cliss; his points ' would be dear and 
his presentations eomlncing. Clasvutea would pay close 
ittentiGQ to whi i he says. 



i 



1.25 



This itudent would talk reasonably well in eliss 
although he would scietliMS h^ troub^i.^pre8sing hist- 
self . The class would scaetiines find hii hard to follow 
and occasional his position on an issue would be 
LOO^Builderstood. 



0.75 



'This 'student might express hiioself-orally 4n an adequate 
' manner, but tils written work laob\ clarity isi organi- 
' sation and iiieanij]g. ^ 



Both wHtten and viitil ecnninica-' 
tion art weiki dtfficult to undei^ 
stand. 
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0.50 



« 



Q^2^Wptudent'8 written work and oral presentations would be so 
' brief , they iroold fail to convince. Long Juops frcn one 
idea to. anothQi: would nake his reasonljK hard to follow, 
^-Th^slstudent's j^sentiticns. would be obscdra and full of^ 
/ incoqalete sentences and gramltic^ errors. It would be 



■>o.od 



almost imposBible to follow his line of thought, 




VI 



Kit Mit WA •iMltlirwj<7» M»lt«fly, 
work, ind othir^fltiTfiMl swpoiiw 
lod vlbnnt. Rueti ipoKtuMuily /o 
jNOplf iQd i^lfli. llijbf vigoi^ 
tod nergeUe tat not MOMmily to* 
(Sm P«nirt«ic« ind DrlTt W.) ' 




Rupondi w«ll>to MbjNtB of specltl 
lnt«pfit,to hlj| but not to othir rob- 
Jects. Convimtion BOBAtlMi l8 
Bodeitt0l7 llvtly but not ibajrs. 



(jkiTMpODiiviinAlApiiilvi. Stldoi 
ihcNi IV intaniti. Doit trait u i 
iiioit^iDttdwithUttlitiiii 
plunri'ln thi p[>6MH. Dull to 

tilkwl th. 



f Thli student would write his papers in such a wajr that 
^each asBigment ai^B tobe a cbaUenge hajiy eagerly . 

accepted. It Is'a phaaure to read bifreporta and one 
1.75 ' i^era that he hatf gotten a kick out of Vrltlng 

When aaked to fill in temporarily on a buaineea gaoe tliua, 
thia student wjuld becone iittrl^ and would enliven 
the sessions with his interests. - 



.50 



.25 



^On SGDS cases, thia student could not be Wpected to volunteer 
discussion, ot) others he could. Mi seeos to be' du^ to 
a difference in Interest rather than in 'preparation, 



0,75 



I 



0.50 

f-Iou could eo^act this studflot to be eager to leave cUss at 
the end of the hour, 9m if the professor was not quite 
finished with his .lecture. 

0.25<'1bie student ipeaki |Q a Boootooe in cIass andlgeneraUy gives 
the iflfireBsioii of not being Interested in the subject. 



. jfj^ stadsnt wold be unr^pbDiive or boredi mn during a ]i 
^1 ii|0liti» amu in iMdf' levinl tem MOt bankrupt 
iikl gm his in oppcrtiidty .to ecnw the iirkft. 



aU^ 



ioliiU«Mnohu|oiilb];|dt)h 

ilwtlikidilmttiodbtiBt^jiN 
ftil«. 8(MUiii dlioilbid u : 
btlm "inntr 4iMoUd." 




/ 



lUi iMt' Ofuld'bi txj^eoted.to^^ hli omthiiii or 
>4k prpiibt lubjlot, without the holp of i fioulty oanbor, 
7 ind to proceed l(i the Mtl&l etigee of the study without . 
. ' specific jujdtooe fwi i faculty . , vi ■ : 
In builneai gwee of 'group leajftlng-offorte, thii studWITbouW 
1.75 be expected to evilAite the probl« 1^ 

ttke the Itf iuggeeting methods of 'so^^tlotf. - ; 

^Klthout any epclfio euggOstlon bjr anyjone, this student could 



y- 1' 



Moderately lelfHUrected) oooaeionaUj 
requlree general direoUcn and «ecur 
artMnt to begin taib. 



■'-r' ^y . U ii to ;'^' 



lllBabUII'Mitloip^e p41 
^Hdree fjrtVMRt iunrvlaloQjaod re* 
asiMi. riAde'lt xeiy ^fflcult 

to VCViDIl Ms OlAv 



1.25 , 



be eicpected to nakei^an appointdt to discuss, a ifiestion ' 
he >d about a point a professor liiade in* a lecture* 




.1' 



Itai would expect this student to finll sources of infoiMfion ' 
' ^ beyojd those suggested Initially by the'profe»or, but.he 
wtnild' require some general direction beforehand. 



1.00 



0.7: 



'^Tou would )iot!«q)ect thS student -to volunteer in class dls- • 
cusSionp,' though .he ndght be Vell-prepared when called on. 



■ / ■ . ' ■ J ■ • 
— Wien required to prepar^an assigniiieiit on a'topic of Ms own , , * 

- ' choosing,. tMs student woulil requif* an ^yistructor's help ', 
0,25 r . la ilfldlag a topic and later onywuld !have to be checked ' , 
on ta «ee ,that the;Jobgot idooe, .^^^^ > • ; . 
In ponductiBg a research proiect; this student could Uf^^ 
t6 depend upon soneone else for the -suggepii^ of 1|ie tppiC) 



ilflijiticn of the-probiflBiSand direction. 



92 



Ji|ibli of jroloniid ittMtioQ to i 
Uik iihithfr Hlf^lnitUtid or ti- - 

unill 1} li c<ipl«tid, Mithoat 
riqtiirlflg'ecPitant lupirviiion. Vorki 
wrgitidllyi Kllhottt dflij ind prih 
cvMtlnitlon« Nijr'undirtike i mnber 
y)f diffirmt'totlvltlM ilnltiniouilj 
in jnr*vlt of I linglt gotl* 




/ 



Cipabl» of prolonged attention to a 
fw tasks iihich art of special per- 
sonal. Intereit Stays with a Uik 
intll it is ccBplsted ^ded there 
aife no eonflictin|s daands on his 

- ' '—^ 



^ 



tti^k idth ifly Usk for CBly a Uilted 
tin* ihibl* to purioe itvml taiki 

eooeon^tl/ to ooipliiriQQ* 



1£ 



<^Thl8 student could bi expected to tiy even harder wh^ he found 
f that a problenm supposedlor' moderate difficulty yesleted 

1.75 -aUinlt^atteketoresolve'^t^ I 

:4-ThJ.s student night propose a research Ideapich requires' 

substantial iunount of cojp'ebpondenc'e to many companies ind 
- which rune ov^r.fr^ tens to the neictv He would keep 
l^y^ up his interest ' ar^ follow up to 'get a Recent per cent 'of 
i. return.- ' . ' \ 

4^You would ei^t this student' to stick with asslgmnents until 
coopleted eve^ when they. are of little interest to him. 



/ 1.25 



) 



^This student eoold be axiiecited to Initiate and sustain a pro- 
1.00 P°'*l .rtudying' a business' opportunity providing there 
' were no coopeting'denands on his tine in other courses 
n during the period. . » ' 



I 

0 
H 



0.75 



f-Iou could expect this student^o finish work that interests hln, 
but to procrastinate on othtt tasks. 



0.50 . . 

f-Zn a library res 
find a few I 
reffleieotj 

0".25 



A' 

eh piper I you could expect this student to 
ferences, hit not to pi^ the literature 
^0 find'the^ pertlniRt nateriil. . 



f-If laubli to soli(eV probl« in probuillty tbeoiy by application 
of fDmilfts di^ied ln elisi, ^) would cxpjiot this student 

togiviupiftirafwltnu^ 

folvetbe vmm byuiing i;tidloai Mtbod of eonntion. 



94 



t M, 



ftM^pUn to m vm, ^^m^ 
to oUnfi iDd to spirliiBt. imth 
vitl^ ind tdaptabli to nqpilMmt 
of loeil oonditlQDi* 



7 



Doeidodly pnfii^i ind is aoat cmr 
fortable with ccnv«itiooil proco- 
durii but roeopiliM vhm ihtj m 
inidoquAte. Cin bo forced to conn 
eider tlten^tlvii but )dth eone 
effort. „ 



Rigid, .pedestii|B md umriUlng to 
deviate f roi ellmtilctil but in- 
adequtte proceduret. 



ERIC 



Mia I 



I 



Nhen i job opportunity oin i along in an area idiich thii 

, student had ndl conildirea, he vould quickly gather 

4-4pproyiate information, preient hlioself velli and wuld oon- 

aider accepting an offer if he were to receive onei 

175 . . 

^In class discussion, this student would be able to nake ap 
effective presentation when told to assume circumstances 
of a case' are radically different from those of actual 

150 



^;^^Ordinarily this student seems able to change his mind vhen he 
is shown to bf wrong. 

<-This*8tudont is able to adapt adequately to changes, but seems 
most comfortable under predictable circunstances. 



0 



75 



<ilhen soQsone in the class suggests a novel idea, you would 
- expect/that it would take this -student sooe^tijne to get 
used to the idea before he would consider it's a^eptance. 
0.5P • .. , 



f^ou would ^ct this student to resist suggestions .for changes 
0.25 while .failing, to explore the validity of his position. 



^IhiB student' could be soqpected to be unreceptive to new ideas 9G 
■^0 X ^ proposals even in 8it\iations where previous methods 



proved inadequate. 



I . » 



ERIC 



MindfiilW undarBtanding of needs, 
feelini^ wd rights of others, and 
Dtakes ailowncei f,or them, ^ffpts 
responsilollity for well-being of his 
associates atii others dependent en 
hljn. Is helii^ul and generous in 
contributing^ his tiie and energies 
to yroup efforts. 



Conslderale and friendly auch of the 
time but not invariably. Can be re- 
lied on to accept the responsibilitiei 
and duties nonnally expected of hljii 
by others." ■ 



9 



Intrusive 'and' dblivi'ous to needs and 
feelings of other^. .Reduces the ef- 
fectiveness of an organiaation by' 
doinding eoccassive tlie and atten- 
tion for hlnself. His personal con- 
venience and well-being are alNays 
-riaary laportance. Nonconf op- 
ERLC aiy be exhibited rt the aprase 



2.00 

This student could be expected to seek out another 
-student without transportation to offer to take hljn home 
' although it was several miles out of his way. 

1.75^his student could be expected to volunteer to help slower 
students unselfishly. 



1.50 



This student would be apologetic about asking a professor 
to repeat a statewnt he had not understood. , 



1.25 



1.00 



This student .would be sensitive to others' needs t|'par- 
ticipate, but would occasionally domfnate a.di^^ussion. 



I 



0.75 . . '1/ j}^ 

—This student occAsionaUy gets so involved, .in his (iin,ideaa^*, 
he has difficulty letting others discuss theiilft . 



0.50 



-OccasionalJjr this student would be' sarcastic to t^ose ,whof 

ask hii for help. ' * ;j 

•I, ''' 

0.25 ■ . , 



•This student would hoard reserve books in the library. 



-^.0.00 



9S 



Table 1 

Distribution of Reallocations, and Levels Aieignad Modal Quality 



Distribution of Reallocations 



Quality: Self-Developnant 



Levels Assigned 



Item 

hi 



SD 



M PB 



TK 



CA 



PA 



RD 



PL 



CS 



MS 



E 



.25 



.50 



.75 



1.00 



1.25 



1.50 1.75 2.00 



Mean Scale 
Value 



i Assigning 
Modal Qual. 



Total No.' 
Judgment? 



28 
52 
257 
181< 
22li 
103 
.178 
155 

m 

219 
109 
1^6.. 
221 
162 
133 
203 
37 
127 
63 
161 



20 
12 
111 
9 
1) 
9 
8 
9 

1? 
.7 

7 
12 

5 
15 
10 
.19 

9 

15 
8 
6 



10 



1 
1 

'i 



4 



3 
2 
6 
2' 
2 
3 



10 

li 
6 

k 
1 
3 
2 
1 
7 



- 1 



1.81j. 

1.75 
1.'75 

1.75 
1.69' 
1.61) • 
1.61 
1.60 

1.57 
l.Olj 

.50 

.27 

.25 

.18 

.15 
.10 

^.08 
.05' 

. .00 
.83 



lOOjt 
86$ 

; M 

m 

33!t' 

m 

39$ 

^92i{ 

11$ 

67$, 

86$ 

90$ 

79$ 

li7$ 

■38$ 



20 

111 

19" 

21 

16 

15 
19 
27 
22 

16 

I 

18 
13 
11) 
21 
15 
22 
10 
19 
17 
16 



Table 2 



Distribution of Reallocations and Lovela Asslgnod Mil Quality 



Quality! Interest in Kanagenent Involvement 



Distribution of Reallocations 



Levels Aa signed 



lion 

10 
132 

95 
131 
■256 
219 
1T9 
229 
.2$1| 
239 

63 



P3 



TK 



10 
12 
1? 

9 

5 

9 

13 

I 

l6 
llj 
10 



CA 



ERIC 



PA 



PL 



CS 



.00 



•IS 



.50 



,?5 



1,00 



1.25 



1.50 



V 



i,?5 

3 
2 



I'lean Scale 
Value 



52 
28 
22 
,00 
78 
,21 
16 
.09 
,08 
.00 



i Asnijnln;' 
Kodal Qu.il 



ni 



60;; 

56^ 



7/C 



39^ 
62^ 



Tot.,'.! :io. 



15 
13 
22 
15 
1!, 
16 

IT 
18 
16 
16 
17 



t I 



Table 3 



blatrlbution of Reallocations and Levels Aaslgned Modal Quality 
Quality I Perapective and Breadth of Knowledge 



Wstrlbution of Reallocations 



Levels Assigned 



Item 
No. 



21 

25 
2li3 

17 
182 
188 

Ii7 

51. 

71 
252 

20 
175 
253 



SD 



PO 



TK 



CA 



PA 



1. 



PL 



CS 



MS 



.00 



.25 



.50 



.75 



1.00 1.25 



1, 



1. 



?.oo 



Mean Scale 
Value 



1.77 
1.71 
1.6? 
1.68 
1.58 
1.55 
1.03 

.32 

.30 

.20 '^ 

.20 

.20 

.15 



$ Assicned Total No. 
Modal Qual. Jud^monls 



100^ 
87$ 
62i( 
63^ 
56? 

n 
m 



\ 



13 
15 

21 
16 
18 
19 
19 
19 
17 
18 
1? 
25 
18 



Tibia li 



Distribution of Reallooitlona ind'Lavo]| Aaolgnad Kodal Quallt/ 



Quality I Tochnicil Knowledge 



I torn 
Wo. 



SI) 



PR 



Distribution of Reallocationi 

TK 



L0V0I9 



CA 



PA 



PL 



CS 



HS 



.00.25 



.50 



J5 



l.C 



1.25 i.$o 



?.oo 



Hoan Scale t Aaslgnod 



Valuo 



lodal Qual 



Total No. 
Jiidl7,ciitr. 



lli 

liil 
117 
6B 
1J6 
1 

lii6 

25? 
8 

110 



lo: 



2 



1.79 
1.75 
1.75 
1.66 

.% 

.89 
.70 

.22 
.03, 



5W 

100^ 

m 
m 
ni 

m 



11 

12 

IB 

19 

20 

15 
20 

15 
18 

20 



ERJC. 



Table 



DlslrlbuUoii olr Ilflulldcalloiin »nii ImU Awlfinml Ktia.il giMlity 



iJaiilUy; IVl Ileal Awaronfliis 



DlnlrlbuUoii of HeallorAtlon!! 



to. 



165 

?? 

lie 

10 

231 
6 

83 
98 
15? 
51i 
lOli 



TK 



1 
1 

n 



ERIC 



PA 



10 
9 

15 
6 
6 
11 
15 
1. 
? 

17 
15 
6 

13 
10 



PL 



r 



1 

I 

3 I 



.00 



lo: 



l.'vO 


1.7'i 


.\00 




i ;, ;M,'i;ril 

'Jm'i..'. ^...al 




? 




, 1 
1. 


l.SO 






c 


3 


1^ 


i.?a 






1 


(^ 


6 


l.?5 










2 


1.','5 




16 




] 




1.6? 




1.'] 


3 


<. 


5 




?«'. 


lu 


3 


3 


? 






1? 




0 




l.?5 


)6'< 


U 




3 


1 


.ay 












.a? 


5l< 


n 








.53 


?ii 


21 




1 




.53 




19 


1 






■U 


aii 


15 


1 






.32 


59? 


1( 

1 

1 

\ 



'Illiiributlon of BedlocAtlona tod AitigMd NikUI QUality 
QuaUtjt Probin AMlyaii AMUty , ' 



Otstrtbutlon of RMllocationt 




Uyela Aaalpied 



4- 



21|0 
53 

ai7' 

226 

h 

217 

X[ 

23ii 
216 
36 
96 
22 
110 
»1 
91 
1:13 
136 
1.3 
H6 

la 

!10 
!08' 
62 
jdl 
3$ 



SO 



CA 



ERIC 



1 
1 
1 



PA 



22 
8 

11 
9 
6 
8 

IS 
8 
5 
11 
11 
111 
16 
9 

111 

3: 
,0 

7 

10 
7 
6 
6 

11 

6 
8 
7 



RD PI 



V 



KS 



1.00 1,25 



1 
1 

2 
1 
1 

11 



1.50 



1.75 



2.00 



20 
6 
7 
6 
2 
2 



1 
2 

li 
3 

\ 



Hiu Scala 
Value 



1.98^^ 

1.87 

1.85 

1.80 

1.79 

1.75- 

1.67 

1.65 

60 ■■ 
1.59 
1.50 
l.li8' 
l.li75 
0.91 
0.90 
0.75 
0.72 
0.71 
0.70 

'o.5li 
ff.50" 

0.1i2 
0.39 

0.25 
0.16 
O.lii 



% Assigned 
Hodal Qual, 



96% 
80j( 

a 

50!{ 

5o)f 
83J{ 

J, 

.28J( 
85$ 
79$ 
67* 
895£ 
66$ 

n% 

23$ 
50$ 
lili$ 
50$ 
39)f 
55$ 
30$ 

58$ 

35$ 
67$ 



)■ Table 7 

Distribution of Reallocaiiona and Levels ^Ass^ned Modal Quality 
Quality: Hesolution and Decisiveness 



No. 


SD 


M 


PB 


All/ 


\ 

CA 


PA 


RD 


rli 


Id 


Wit 

ns 


f D 


T 

1 


D 

r 


y 
f 


n 
u 








. I? 


1 nn 


1 2^ 

XtLJ 


1 ?0 


1 75 


2.00 


Hean Scale 
Value 


i Assigned 
Kodal Qual. 


Total lb. 
Judmonts 


172 










2 




20 














2 
















2 


6 


12 


1.88 


83^ 


21 


107 














18 






























2 


5 


11 


1.87 ' 


100^ 


■18 


llj2 




1 


1 


6 


■ 


1 


9 






1 




1 








r 












2 


Ji 


3 


1.78 


m 


' 20 


111 










1 




13 










1 




















2 


8 


3 


. 1.77 


m 


15 


2 














1? 


















■ 




{ 




1 


2 


$ 


6 


3 


1.62 


¥ 


,21 


139 












> 


10 










3 














1 


3 


3 








.87 


.71!5 


11; 


.56 














16 














1 








\ 


7 


3 


1" 






A 

(f \ 


.73 


91S 


17 


89 


S 












5 










7 




3 




2 








1 








2 


.65 • 


33!{ 


15 


,87 




1 






3 


8 








1; 


1 








1 




1 


2 


2, 










.56 




17 • 


153 








• 


2 




17 ■ 














1 

•\ 




2 




5 


5 


2 










.51; 


39^ 


19 


212 












■1 


16 




• 














3~ 




5 


2 


2 


1. 








.50, . 


_ 9\S ' 


'17 


22? 


1 










1 


19 


• 












2 




5 




3 




2 . 








2 




83? 


■21 


150 










1 


1 


9 , 










1 








2 




1 


2 






1,, 








> 


12 • 


no 


1 






8 






8 


1 


1 










1 








li 


1 ' 










• 






20 


51 








1 




1 


U 










w 








1 




2 


1 












,kh 


; 33? 


12 , 


15 














11 










'3' 








3 




2 




1 










.30 


n 


- Hi 


50 










1 




9 




h ■ 






2 




6 




6 




1 




1 










• ,.19 




18 


159 


3 






















2 








11 




2 




1 










.16 


n 


21. 


93 






(. 








13 










1 








LO 






r 


1 










.15, ' 




11, 



erJcIO 



r 



■/ 

/ 



■I i 



' 4 



' . • _ ■ . Table 8 ' 

DlstrlbutloA of Reallocations* and Levels Assigned Hodal Quality 
Quality: Planning S«x linpleientatlon 

Distribution. of Reallocations 



iltenj 

i 



SD 



PB 



TK 



CA 



PA 



PL 



CS 



HS^ 



.00 



.25 



.50 



.75 



1.001.25 



1.50 i.?5 



2.00 



Mean Scale 
Value 



i Assignee 
Hpaal Qual. 



Total No. 
Judpents 



j 

29'; 

1 

52' 
178 
190^ 

81 
161. 
189 
259 

21. 
180 
213 
116 
■119 



0 



ERIC 



10 
12 
10 

15 

10 

11 

13 
8 

8 

Hi 

20 
12 
10 



1.82 
1.83 



1.75 



1.7li 
1.68 
l.Slj' 
1.62 
1.59 
1.56 
.98 
.81 
.71 
'.Ii8 
.225 
.125 



50^ 

%. 

. Ii8 
% 
53 
52 

50 

50 

86 
100 
•87 

71 

50 ' 
73 



20 

21 
16 
19 
21 
16 
16 
16 
16 
13 
23 
17 
20 
11 



11] 



Table 9 



4 ■ 



Diatrlbution of Reallocations and Levels Assigned Modal, Quality 



' Quality; Coamunication Skill 



Distribixion of Reallocations 



Item 
No. 



SD 



PB 



TKCA 



PA 



,RD 



PL 



CS 



MS 



.00.25 



.50 



.75 



l.OO 1.21 



11.50 L75, 

-4 — m ^" i « tt\ 



2.00 



Mean Scale i Assigned 
. Value Modal Qual. 



Total No. 
Judgments 



86 

n 

71» 
67 
M 
120 
262 
31 
78 
238 
196 

55 
108 
186 
100 
263 
167 



1 



I II- 



5 
li 
5 
1 

1 



1 

2 

12 
13 
1 



li 

10 

5 

8 

li 



1.90 
1.83 
1.82 

1.79 

1.6l' 

0.9li 

0.93 

0.61 

0.1i7 

0.38 

0.33 

0.22, 

0.21 

0.12 

0.11 

O.Q8v 

0.03 



2% 

m 

93K 
93i{ 
100!^ 
9Si 

50? 
M 
95? 
83? 
86? 
68? 
100? 
100? 
33? 



20 
18 
11 
15 
15 

20 
22 
lli 
16 
16 
20 
12 
21 

25 
20 

19 
18 
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Table 10 



ml^ributlon of Reallocations and Levels Assigned Hodal ^^lallty 
' Quality: Managerial ^11 

■ - \ : . • 

Distribution of Reallocations levels Assigned 



Itto' 
'No. 



SD 



PB 



TK 



CA 



PA 



RD 



PL 



CS 



MS 



.00 



.25 



.50 



.75 



l.OC 1.2M.5C 1.75 



2.00 



Scalej^ Assigned 
fodil Qual 



Total No. 
Judtinwits 



230 
65 
197 

M 
66 
llO 
18 

.32 
128 

166 

232 




1.80 
1.79 
1.78 
1.71 
1.68 
1.67 
1.62 
■1.50 
.55 
.39 
.12 



Hi 
57? 



looi 



18 
12 
20' 
111 
18 
20 
18 
16 
19 
16 
12 



Table 11 



uVon of 



Distrlburion of Reallocations and Levels Assigned )fcidal Quality 



Quality: fhUiuslasni 



Distributions of Reallocations 



Levels Assigned 



PB 



TK 



CA 



PA 



RD 



PL 



OS 



MS 



3 



.00 



2^ JO 



17 
3 
7 
6 
3 
6 
6 
2 



2 

li 
2 

9'1 
li 
3 
2 



Hean Scale 
Value- 



1.91 
' 1.90 
1.83 
1.75 
1.71 
1.70"* 
1.68 
1.58 
l.llj 
.97 
.35 
.25, 
.08 
.07 
.01; 



i Assigned 
Modal Oual. 



^100? 

M 

93i{ 



3\{ 



9i:{ 

li7^ 

1% 

M 



Table 12 



Distribution of Reallocations and Ldvela Aesignad Kodal Qualltj 
Quality! Initiative 



Astributions of ReallocatioDS 



Levels Assigni 



Item 
No. 



SD 



PB 



TK 



CA 



PA 



RD 



CS 



16 E 



.00 



.25 



.50 



.75 



l.OO 1.2? 



1. 



2.00 



Kean Scale i Assigned 
Value Xodal Qual. 



Total No. 

Judgments 



T-T 



76 
191. 
160 
21i7 
80 
185 
1Ij9 
153 
191 
1^ 
190 
215 
109 
222 
79 
61. 
59 
193 
51 
221 
13 
89 

ERIC 



1 1 



11 



1 

5i 2 
1 



1.91 
1.67 
1.82 
1.77 
1.77 
1.70 
1.62 
1.60 
1.59 
1.59 
1.55 
.71 
.50 
.1)8 
.30 
.30 
.25 
.25 
.25 
.20 

.17 

.01. 



85? 
761 

%i 

671 
811 
,501 
331 
571 
391 
881 
851 
li51 
521 
1)11 
501 
361 
931 
1)71 



18 
20 
22 
23 
17 
21 
19 
18 
21 
16 
21 
21 
18 
26 
20 
22 
21 
17 
12 
11) 
U 
15 



Table 13 



Distribution of Reallocations and Levels Assigned Modal Quality 
Quality: Persistence and Drive 

Distributions, of Reallocations 



Item 
Ho. 


SD 


H 


PB 


TK 


CA 


PA 


RD 


PL 


cs 


KS 


E 


I 


{ 


F 


C 


.00 


.25 


.50 


.?5 


1.00 


1.25 


ft 

i.5q 


1.75 


2.00 


Kean Scale 
Value 


jTAssigned 
Modal Qual. 


Total No. 
Judgments . 


7 


■r— 






















3 


"1 

U 


2 














1 




2 


8 


1.81) 


% 


19 


126 














1) 












15 


1 


















10 


5 


l.Bj 






13V 












1 










1 


2 


10 


















li 


1 


5 


.1.77 


535J 


19 


236 
























1 


19 
















2 


2 


11 


1 

1) 


1.72 




23 


161) 


9 






















2 


8 


1 
















3 


1) 


1 


1.68 




21 


'1)6 


























15 
















2 


5 


1) 


1) 


1.67 




15 


99 


























21) 












1 


2 


1) 


7 




6 


■ 1.55 


m 


25 


39 


1 


3 










2 










2 


8 












1 


5 


1 


1 






1.06' 


1)7 A 


17 


121 


1 










3 




\ 










10 






1 


1) 


2 


1 


? 










.1)7" 


67?M 


,15 


129 










1 
















11 




• 6 


3 


2 


1) 


2 




V 






1 


■ .36 


6l!( 


18 


202 


















■ 






1 


20 

\ 






8 


1) 


5 


2 


1 








f 


. .30 


95!t 


21 

( 

( 


4 


















i 
































* 







Table IL 

milributlon of Reallocations and Levels Assigned Hodal Quality 
Quality: Flexibility 



Distribution of Reallocations Le vels Assigned 



Iton 


SD 


K PD 


n 


CA 


PA 


RD 


PL 


CS 


MS 


£ 


I 


n 

r 


n 
P 




,UU 






71; 
!?, 


1 no 

iiUU 




1 Cn' 


1 71? 


5 nn 


((ean Scale 


i Assigned 


Total No. 


9 


5 












V 






1 






16 
















2 


7 




1.83 


70!! 


23 


2U 
138 




2 




I 
3 


6 


1 


1 




li 




1 




13 
8 


V 
? 












• 


3 
2 


3 
3 




1.63 
l.?9 


)% 


2li 
23 


38 


1 






2 


1) 










2 


1 




6 
















2 


li 




1.75 


U 


la 


M 










6 






1 






1 




lii 














, 1 


3 


6, 


i 


1.73 


m 


22 ; 


258 




1 


1 




5 


1 




1 










11 










2 


ll 










, 0.73 


1 


20 


11 




1 


1 


1 
























3 




1 


3 


1 








0.62 


82jl 


17 


M 


5 






.1 












1 


3 


3 


\ 




1 


3 






1 










0.39 


35? 


20 


•m 




[ 






2 
















17 




8 


3 




2 


1 










0.26 


89^ 


19 


2lil> 








1 




ll 






•2 








8 




1) 


2 




1 












0.22 


53^ 


15 


223 






1 




3 


1 










1 




15 




9 


1 




1 












0.20 


71$ 


21 


19 

9.i 








/ 

\ 


2 

f 
















12 




9 


2 


; 












a 


0.08 

4, 


m >; 

\, 


llj 

\ 
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Dijtrlbution cf Itoallocaticin and Levels Assigned Modal Quality 



Quality! Consideration 



Distribution of Reallocations 



Levels Assigned 



Item 
No. 



SD 



PB 



TK 



CA 



PA 



RD 



PL 



CS 



MS 



.00 



.25 



.50 



.75 1.00 1.25 



1.50 1.75 2.00 



Mean Scale i Assigned 
Value Modal Qual. 



20li 
lU 
230 
115 
I6li 
61 
195 
26 
181 
177 
183 
173 
129 
192 
166 
250 

151 
i5li 
i. 

137 

TW1 



12- 



11 



3 
2 

7 
2 
2 
1 
k 
12 
li 
13 
11. 



1.83 
1.79 
1.79 
1.78 
1.75' 
1.75 
1.65 
1.63 
1.60 
1.60 
LUj 
1.28 
.58 

.39 
.38 
.35 
.33 
'.'32 
.26 
.16 
.17 
.07 
.02 



looi 

■ 81^ 
39K 
881 
96^ 

m 

91^ 

m 

59)( 
33< 
M 

m 

92K' 
tlX 
62)1 

1*7^ 

m 
m 

1009( 
7911 
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Appendix E 



Personal Background Data Form 



In order to understand various aspects of success in graduate work, several 
graduate schools of business administration are collaborating vdth Educational Testing 
Service in a Joint research effort. 

Your administration and faculty are .cooperating in this woric, and we need your 
help. We need information on your personal background, on your feelings, and on your 
attitudes. We have developed a questionnaire in which we ask you to give us this 
' variety of information about yourself, usually by marking the one alternative out j^f 
several -vrtiich best or most nearly describes you. 

Because this is a research study, the information will be treated confidentially 
and will not be a part of your academic record. Specific answers given by specific 
students will not be made known to the administration or faculty. Only group trends, 
group relations, and grouped frequencies of response will be provided in summarizing 
the results of this research. The data you give ua today on the attached forms will 
stay in the possession of Educational Testing Service from today on. 

Because some of the information we are requesting is personal, you are free to 
omit any particular question(s). We hope that most or even all of you will answer all 
the questions, but each of you does have the option to refuse to answer any particular 
question. ' 

We are asking you to put your name on the questionnaire, however, because in o\xt 
research we want to explore the relation or lack of relation >*iich the questionnaire 
items have with your academic grades, as well as with ratings and other descriptions 
of your whole performance as a student in this graduate school. 

There is no time limit, but you probably will not need more than an hour to record 
the information requested. If any question is ambiguous or not quite applicable to you 
please add explanatory comments in the margin. 



Thank you. 



Educational TestihgService 
September, 1%5 
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^ -E2- 

^ Pergonal Data 

Today '3 

( 1 ) Your name : ' \date : ^ 19 

(last) (first) (middle initial) ^ 

(2) Your permanent 

address: . 

.(3) Name of graduate school of business you are nov/ attending: 



(A) Your data _ n Woio 

of birth:^ ^ • (5) Citizen of USA? ^ (6) Sex: 

(Month, day/ year) [D No □ Female 

(7) Is English your native language? ^ (8) If no, please specify your 

Q No native language: 



[~\ Engaged Q Divorced 
□ Married □ Widowed 

Milltaiy Service : (ll) Entered,^ (12) Separated^^ 

(Year, month) ^ (Year, month) 

Rank when 

(13) Branch of service :_^ (14) separated:^ 



(15) Military awards and honors: 



Ma>1or gobbles or Avocations in last 5 years 

(16) Name or (17) For which (18) Amount of (19) Amount of money 

description years? time spent/month spent/month 



(20) List any professional organizations to which you belong: 



(21) List any community groups or activities in which you have participated in the 
last 5 to 8 years (please star those in which you have been particularly 
active): 



Personal Data (cont,) 

(22) Ax*e you interested in teaching or research as a career? Q Yes , 

n Uncertain 
□ No . 

* (23) About how many books do you own, counting paper backs? 

Circle one: Under 50 50-74 75-99 100-199 200-499 500 + 

(24) About what percentage are fiction? 

(25) ^ the non-fiction, do they represent any areas of interest you can specliy? 



(26) Which of the following best describes the community which you think of as your 
home town during your high school days? 

Q Suburb in a metropolitan area of more than 2,000,000 population 

□ Suburb_in a metropoUtan area of 500,000 to 2,000,000 

□ Suburb in a metropolitan area of 100,000 to 500,000 
Q , In a city (not a suburb) of more than(, 500,000 

□ In a city of 50,000 to 500,000 

□ City or town of 10,000 to 50,000 
Q Town of less than 10,000 

Q Farm, ranch or other open country 

(27) How long ago did you decide you wanted to go to a graduate school of business? 

□ In high school . □ In Junior year college 

□ In Freshman year of college O In Senior year of college 

n In Sophomore year of college Q After graduation from college 

II. Physical Condition (28) Height: (29) Weight: 



(30) Estimated total time lost from work or school 
in last two years due to illness: days 

(31) Types of illness lAich lasted 4 days or more during that time: 



(52) How would you describe your general health condition? 
> Vr>9^ Excellent^ Good ^ Average Fair Poor^ 



For each of the follovdng membera of your family please give their proaenb ago and 
educational level. 

Age need only be approximate. For present educational level please use the follovrtng 
code; * 

(l) Some high school or less ^(2) High school graduate 

(3) Some college after high school (4) College graduate 

(5) Advanced study beyond college (6) Advanced degree beyond college 



Family 
' Member 

(33) Father 

(34) Mother 

(35) Brother 

(36) Brother 
• (37) Brother 

(38) B rother 

(39) Slater 
(AO) Slater 
(U) Slater 

(42) Slitter 

(43) _J. 

(44) ' 

(45) ^ 

(46) Spouse 

(47) Your child 

(48) Your child 
(/^) Your child 

(50) Your child 

(51) Your child 

(52) Your child 



Approximate 



Present Educational Level 
(Use Cody 1 to 6 as above) 



If deceased, 
give year 



J3I 



gpy(^ Other dependent 



Cteneral Background (cont.) 



(54) Which of the follovdng categories comes closest to describing your father's 
occupation? 

If your father is retired, deceased, or unemployed, indicate his former or 
customary occupation. (Circle only one number from 1 through 9 below.) 

1. Unskilled worker, laborer, fann woricer 

2. Semiskilled worker (e.g., machine operator)- 

3* Service worker (policeman, fireman, barber, military noncommlSBioned 
officer, etc.) 

4. Skilled worker or craftsman (carpenter, electrician, plumber, etc.) 

5. Salesman, bookkeeper, seci^etary, office worker, etc. 

6. Owner, manager, partner of a small business] lower level governmental 
official; military commissioned officer 

7. Profession requiring a bachelor's degree (engineer, elementary or 
secondary teacher, etc.) 

8. Owner, high-level executive — large business or high-level government agency 

9. Profession requiring an advanced college degree (doctor, lawyer, college 
professor, etc) 

(55) Has your mother worked for wages or salary at any time sinpe you were bom? 

n No (If no, skip to section IV below asking about your educational 
background. ) 

n Yes (If yes, which alternative in question 54 comes closest to describing 
the kind of woiic your mother does, or did? ' Circle one number 
immediately below* ) 

(56) 1 2 3 4 5 6 7 8 9 

IV. Your Educational Background 

(If any of the following courses of study were under the supervision of any of the 
Armed Searvices, please so indicate in space for "name of school.") 

(57) High School: (58) Location: 

(name of school) 

(59) Years: Fro m (60) to (61) □''l^^ate? 

/Ci^^ □ Public? 

(62) Approximate size of H. S. graduating class: □ 1-24 Q 25-99 

Er|c O □ A00 + 



\ 



ColleKo(a) : 



(63). 
(6/J. 

(65) . 

(66) ^ 



(67) Major rield of study:. 

(6B) Minor field(3): 

Graduate SchoolCa) ; 

(69) 



I/)catlon 



Years 
Att^^nded 



Location 



Years 
Attended 



Degree (if any) 
and year 



Degree (if any) 
and year 



(70) . 

(71) . 



(72) Major field of study:. 

(73) Minor field(s): 

Other achoolln/;^ ; 

(74) • 



Location 



Years 
Attended 



Course, 
diploma, year 



(75) . 

(76) . 

(77) . 



Liat and briefly characterize any academic honors^ distinctions, publications, 
research, inventions, awards or scholax'ships (academic or non-academic), etc.: 

(78) a. In high school: * 



(79) b. In college :^ 



/ \ n Yes 

(80) Do you believe that your college grades accurately reflect your ability? ^ 

□ no 

(3^ If no, suggest briefly on the lines below the circumstances and the nature of 
the influence: 



Your Educational Background (cont.) 

Since receiving your bachelor's degree, have you finished other course-work? 

(82) □ No, I have not 

(83) n No, because I have not yet finished a bachelor's degree (expect to on_ 

(84) O Yes, for a formal degree in^ , 



(85) n Yes, for certification requirements in ^ 

(86) O Yes, to prepare myself fdr a new Job (job naxne?)^ 
(8?) El Yes, but for my own interest only (course?) 



(88) Q Yes, for othor reason (name course and reason)^ 



(89) Do you plan to go on for a doctorate degree? 

Si /^nificant extra-curricular activities in college ; 
Club Membershipfs) 

(90 ) Soci al/Frate mity ■ 



□ Yes 

n Uncertain 

□ No 



(91) Honorary (describe) 



(92) Community (describe or name)_ 



ERIC 



Organization offices held in college ; 



Title or position 



(93) 
(%) 
(95) 
(96) 



SpoiT^Th college ; 
Name 

(97) 

(98) 

(99) 

(100) 



Years: 
From/To 



Name of group 



• YearCs) 



Position 



Intramural? 

Varsity? marie Manager? 
Squad or Letter Captain? 



Yc\xr I'/lu<: at lonal n ack)j:rou^ifl (i: nnt . ) 

(101) How much conjciouy can?er pl.aiiunK have you rn^'^a^v-d in? 

Q \liny little. [ cannot rncall Q 'Jult<' a bit oT ritauiy ,and ,^^'^1 f-analyala 

thinking about it much t — i ^ . . , . ... , , 
' \ I Kxt'.'n^iive :jtudy .'ind soK -analya I3 

[j Some thoiiy,ht haii boon Kivon r"l ^ t i i ^ r 11 

* — ' 1.J i. i.j J Continuous stiidy and solf-analysia 

Irom time to time ^ — ' ^ ^ 

(102) Which of the follovdng best deucribrs how you rir:jt frit al>out your current 
career choice, i.e., at tin? time you made it, how did you fe»^l about it? 



(~1 Decidedly Q Somewhat Q O.K.; some doubts 
uneasy uneasy but no serious ones 

O No '^choice" yet— r^till deciding 

(103) How do you feel now about your current career choice? 

I 1 Decidedly Q Somewhat Q O.K.; some doubts 
uneasy uneasy but no serious ones 



1 1 No qualms 
whatsoever 



( 1 No qualms 
whatsoever 



I I No '^choice" yet — still deciding 



V. lihployment Experience 



Summer activities wtule in collcj^e. Include summer employment 

Describe nature of ."lob 





1. 


(105) 


2. 


(106) 


3. 


(107) 


h. 


(108) 


5. 



job or activities only)_ 
Part-time work '^ile in colle>;e 
(109) 1. Freshman: Describe job_ 



No. of 
(110) Hours /week_ 



(ill) 2. Sophomore: Describe job 



No. of 
(112) Hours/week, 



(113) 3. Junior: Describe Job_ 



No. of 
(11/+) Hours/week 



Bnployment Experience (coni#) 
(115) A* Senior: Describe Job_ 



No. of 
(116 ) Hours/week^ 



Full-time employment - List most recent position first. List no more than four. (Use 
two lines for each.) 

Monthly 

Organization Fron^ ^ To Title Duties Salary 



(117). 



(118). 



V 



(119). 



(120)_ 



VI. Financial Status 



Considering all money borroaved, how much money 
(circle one number only in each row below.) 



(121) a. do you personally owe now 

for undergraduate training? 

(122) b. have you borrowed for this 

yearns graduate^ study? 

(123) c. do you expect tSo borrow for 

graduate study next year? 

(124) d. do you owe now for major 

consimtter goods (car, 
appliances, etc.)? 



None 



.... 

Less than 
$500 



$500 ( $1,000 

to $999 to $/,.999 $5.000+ 



3 
3 



-Elo- 

Financial status (cont,) 

How much do you personally have in th6 fom of savings and securities (or other assets 
which could be converted into cash in an emergency, except your house) and how much 
are you currently in debt (excluding mortgages, bills paid within the month, etc,)? 
(Circl^one number only in each column below.) 
^^^^^ . Debts and 

Assets Liabilities 

(125) Nothing 0 ^ 0 

(126) Leas than $100 1 1 

(127) $100 - $499 '2 2 

(128) $500 - $999 3 . 3 " 

(129) $1,000 - $4,999 4- 4 . 

(130) $5,000 or more , 5 5 

(131) Please indicate how much financial assistance you can expect to receive from" 
parents and relatives during your graduate studies . Include only gifts or 
loans vdth voluntary repayment. 



n ' None ^ 
ri Very limited (less than $100 each year) 

Q As much as needed, within limits (specify probable maximum $ 

I I As much as needed 

(132) Approximate amount of Life Insurance carried (in tho>ifanda): 

□ None . □ 1 - 5 

□ 6 - 10 ^ □ 11 - 20 

. □ 21 - ,50 ^ □ 51 - 100 

□ 101 + " / 
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A MUlUAL FOR 
A STUDY OF CRITERION RATING SC^ES 
IN BUSINESS SCHOOLS 



Preparedly: Educational Testing Service^ , 
Princeton, New Jeraey 

For: Th^ ATGSB Research and Development 
Gonndttee 



Februi^ I965 



13, 
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A Manual for 
A study of Criterion Rating Scales 

\ln Business Schools ^ 



You have agreed to cooperate in testing a set of rating scales developed 
to provide a broader basis for evaluating graduate students in business than is 
provided bj grades alone. It has long been suspected that the personal qualities 
of students may have as much to do with their later success in business as does 
I their academic performance and that such personal qualities ought to be taken into 
account at the point of admission to graduate study. However^ the study of such 
admissions information has been haiq)ered by the fact that grades do not provide a 
broad enough criterion against which to test its efficacy in selecting students 
having the desired personal qualities. The present study is «i attempt to provide 
additional criterion measures which will make possible the developnftxt of new ad^ 
missions measures, and the more effective use of those now existing « 

Development of the Hatli^ Scales 

The development of the rating scales was authorised by the ATG^ Polity 
Committee and was carried out through the cooperative efforts of a panel of con^ 
sultants selected from business school fadultles, the ATSSB Research, and Developnent 
Connittee^ and members of the ETS staff. The quallues to be rated were defined in 
general terms and illustrative Instances Intended to define those ^ qualities were 
collected. The consultants obtained the cooperation of some eighty additional 
faculty xLeBoiBfrB yAio Independently reallocated the Illustrative instances to the 
various scalM a^ a means of finding the least ambiguous exanQ>les. We believe that 
the resulting scales embody student qualities whlcK are of importance in graduate 
business education and that, by virtue of carefully devised general definitions and 
concrete anchoring instances ^ they constljtute an Instrument which can be usedl)y 
business school facult4e8 to provide accurate and reliable ratings. 



Nature of the Study . ^ 

In brief, we are asking you to use the scales in rating several of your 
students. We would like you to follow the procedures described In this Manual as 
carefully as possible In order to provide us with the information necessary to assess 
the suitability of the scales. At this stage we are Interested primarily in appli- 
cation of the scales as a research Instrument. We want to determine whether the 
scales themselves are satisfactoxy for research use, iidxether they get at relevant 
and important qualities, and whether the combination of general definitions and 
illustrations deflpes the scales with sufficient clarltyi^ ' 

4 



If the ra'^lng scales are used operatiorially, they will not necessarily be used 
^continuously, or even frequently, or for all students. A school wishing to deter- 
mine l^^iirtiat degree the qualities represented In the scales characterise its student 
^ body Wmld probably use the scalds intensively In the course of one study and might 
not use them again for several years. Furthermore, It might be decided to use only 
O bl subset of the total number of scales. Thus, the demands on the faculty would be 
ERIC. heavy but of limited duration. ^ ' 



I 

I 
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As In any attenqpt at evaluation through the use of Judges, the value of 
the. Information produced depends primarily oh the conscientiousness with which the 
Judges approach thair task and the energy they are willing to put into the Judging 
process* In setting up the prociedures described below^ we have detoanded a good 
deal of the Judges, but we have tried to keep those demands to the minlimim irtiich is 
consistent with the production of sound Judgments « 

Selection of Students to be Rated ^ - ' 

Several students known to be mesobers of your classes have been selected 
for yoiur rating. The assignment of s^^ific students to each rater is intended to 
focus the rater ^s attention on a few students with whom he has a reasonable degree 
of contact. 



Obseinration of Students in Preparation ^Srlfiating 



You will be asked to provide ratings on each of 13 qualities for each of 
the students assi^ed to you. In preparation for this step, you should familiarise 
yourself throughly with the meaning of the scales, using both the general defini- 
tions at the head of each scale and the illustrative exanples defining varloiis 
points along the scale* You should not accept as a scale definition something 
which is suggested to you by the title of the scale alone. The words making up 
these titles will have different meanings for different people. The extended 
definitions and the illustrative incidents provided are intended to specify 
exactly what isSneant bv the scale titles for purposes of this study. It is 
inportant that these d^initionS^® accepted without contamination by divergent 
personal definitions, /Once the meanings of the scales have;^een grasped, a 
deliberate effort should be made to apply them in observing the behavior of the 
selected students. 

You are asked^ to become sufficiently familiar with your selected students 
to render valid Judgments about the extent to which they display the qualities to 
be rated. You should deliberately attempt to obsexnre h^avipr in the assigned 
students which is indicative of the ,iq[ualities defined^^l^- 1^^ scales. Such behavior 
will probably be displayed mostly throiigh class ihti^afctioiTp^d through written 
assignments. However, some qualities lend theniselves more easily %p rating through^ 
non*academic behavior and we^hope that opportunities can be foi^id for observing that 
type of behavior. 

You should begin systematic observation c/f your students immediately. No 
method for d^ig tlfis is prescribed, and it is expected that there will be , consider- 
able variation. Some observers may. wish to make notes, from time to time, about 
particularly relevant behavior displayed by the students assigned to them. Others 
may^wish to rely on their memories. ;However the observations are made and recorde^d, 
the aim should be to isolate clear-cut, concrete instances which demonstrate the 
qualities defined by the, scales and which can be brought clearly to mind when the 
ratings are made. 
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Making the Ratings Based on Reconstructed Incidents 

Three or Xour weeks after you begin observing your students, you ahould 
make your ratings. You should try to reconstruct several specific incldenta rele- 
vant to each quality. If you wish it is pennisslble to refer to notes and other 
records which would assist you in reconstructing relevant ineidents. 

A separate form is provided for recording all incidents and ratings for 
each student. As an illustration, a Judge might reconstruct and record the following 
four incidents as relevant to the quality of Consideration for a particular student. 



Scale Value 



Cdnposite 

1 L 



13. Consideration (C) 

Gave undivided attention to rather uninspired comnents of a 
classmate in seminar. 



Was careful to criticize a suggested action rather than the 
student suggesting it. 

Came to class unshaven uhbathed to the obvious embarrassment^ 
and discomfort of his jassociates. ' 

Showed nm student where to get supplies and talked to him 
understandlngly about problem of acconkodation. 



The incidents yofl record will be helpful to us in making possible future 
revisions of the scales, in addition to being used now as a basis for ratings. 

Each reconstructed incident, is to be rated in relation to the reference 
points provided by the definitions and exanqples in the^booklet of ratings scales. 

The illustrative examples furnished with the scale are intended to ^ypify 
the kind of behavior which eihbodies the quality in question. The behavioral inci- 
dents you observe in your students will not necessarily match the illustrative 
incidents we have supplied. For each of your observed instances you will have to 
make a Judgment as to which of the illustrative instances it most resembles ^ or 
which of the illustrative incidents you would most expect the candidate to display 
on the basis of vrtiat you observed. 

>" 

The first incident recorded in the sacqple suggests much more than a con- 
ventional degree of consideration and might be judged to fall within the region of ^ 
the top two examples on the rating scale. This student who gives undivided attention^ 
to uninspired comments of a classmate does so out of consideration. He could Reason- 
ably be expected tp^show consideration as well to the extent of helping slower 
students or offex^^ a ride to another student without transportation. This ob- 
served incident could be assigned a scale value of about 1.8. placing it between the 
top two illustrations. This scale value is recorded in the column to the left of 
the descriptive sentence. 

Similarly, the second incident is rated. Perhaps it is Judged as showing 
about the same degree of consideration or Just slightly less. It might be assigned 
d scale value of about which rs recorded in the column to the left. 



The thix^ incident indicates a great lack of ^Rpnsideration and might be 
rated at the very bottom of the scale, possibly with a scale value of 0.0 . 

The fourth incident might be Judged to fall between the second and third 
illustrations from the top of the scale and might be assigned a scale value of about 
1.6. 



The recorded ratings shoxild appear below. 



Scale Value 




1.8 




1.7 




0.0 '• 




1.6 




Composite 




( ) 





: • : ■ ■ . ■ ^ • 

Notice that at this stage you are rating discrete exB2i9>le8 of observed 
studeiit behavior and an overall evaluation of the student's Conaideration is not 
made yet. 

If you have not been able to reconstruct specific instances of the student's 
behavior, but have a general impression about where he: falls on the scale for a given 
quality, record the appropriate scale value in the space provided and indicate by 
the letters IM (ijiq>ression) that the rating was based only on a general impression. 
Since these ratings are mu^h less useful than those based on recordable observations 
they should be kept to a minimum* It may be that aji€^of these will be necessary 
on the first attempt to make ratings. We hope that^if\hey occur, you will make a 
special point of making supplementary observationsi f^r that student. 
. Obtaining a Summary Rating of Several Reconstructecr Incidents 

Enough incidents should be reconstructed and rated to provide ^at in your 
Judgment is a representative saaqple of behavior characteristic of the student. Once 
this is done, you should arrive at a summary Judgment of the student with respect to 
the given quality. It is not advisable for this purpose simply to average the earlier 
ratings. It may' be that you will want to weight the. rating of one incident more 
neavily than the others. A particular rating might be better than earlier ones be-. ^ 
cause you knew the student better and the observed Incident was more characteristic 
than earlier ones. Your sunnary ratings on each qiiality will, therefore, require the 
exercise of Judgment and will represent the best rating of the student you can make in 
the light of all the evidence you have been able to gather. 

In the sasqple, the third incident involving an unkeoipt appearance might be 
very atypical and should be coiq)letely discounted in arriving at a sumnary rating. 
Perhaps the students' house bximed down the previous night, in which case a composite 
value of about 1.7 would be most appropriate. On the other hand, thereHmTght be no 
good reason to Justify such an incident and it might be treated as an instance of a 
gross lack of consideration and given extra weight to produce a composite rating as ^ 
lotf as 0>5 . In the absence of any information on the characteristicness of various 
incidents, equal weight might be assigned to each to arrive at a composite of about 



The sumnary or composite vaXue for each quality Ib ]*ecorded In the appro- 
priate parenthesis In the left column. 



Recapitulation 

To sumiarlBe the steps for use of the scales: 

1. Become familiar with the scales, the general definitions of each quality, 
and the content of relevant behaviors used to Illustrate the quslltlet. 

2. Observe the students assigned to you over a period of several weeks, pay- 
ing particular attention to incidents relevant to the qualities you are 
to rate. 

3* At the end of the observation period, begin your rating of a particular 
student by reading the reference Information on e given scale and recon-> - 
struct a specific Incident relevant to the quality. If possible, make 
a brief descriptive note of the Incident on the rating form. 

4. Rate the specific Incident, using the e7caiiQ>les we have provided as 
reference^ points. ^ 

3. Recor;(8truct and rate additional incidents as necessary. 

6, Combine all available information to form a sunmary evaluation on the 
particular quality, making appropriate al^wances for the relevance and 
importance of specific incidents rated on the quality. 

7. Repeat the above steps for each of the scales, producing 13 suamaiy ratings 
(one for each of the qualities) for each student assigned to you. 



3USIME$S SCHOOL RATB'G SCALE RECORD FOPJt 



Use a separate copy of this fom to record relevant information used in rating, each student assigned to you. 
Complete the identification data and any appropriate criterion data. Brief descriptions of observed behavior should 
be recorded in the section corresponding to the relevant quality. Rate each observed incident usir^ the separate book- 
let of general definitions and anchoring illustrations as a reference. Record your rating for each statement in the 
colvjiin at the left. At the end of the study iwke a sumarj' of all ratings in a given section and record this sumary 
in the appropriate parentheses on the left, 



Student Rated 



Judge's Name 



School 



(first) (middle initial) (last) 

Date l^servations Began 



Date' of Sumry Ratings 




Most recent cumulative Graduate Avg 



•(How many semesters? 



Undergraduage Avg 



Ist Semester Graduate Avg 



Ist yr. Graduate Ave 
Quantitative 



Other: 




/ 



'Scale Value 



1. Self-Dgvelotient (SD) 





Scale Value 



Cdmposite 

1 I 



2. Perspective and Breadth of Knowledge (PB) 



Scale Value 



Conoosite 

» 

i L 



3. Technical Knowledge (HC) 



Scal'B Value 



Contposite 

( y 



Scale Value 



k. Critical" Awareness (CA) 




5. Problem Analysis Ability (PA) 



143 



Sole Value 



Conqpoelte 

1 ^ 



I 



6, Resolution and Declalveneae (HP) 



Scale Value 



Coii^)08lte 
Scale Value 



Contpoeite 
Scale Value 



ERIC 



7« Planning for linDlementatlon 



6. Connaunic Atlon SHU (f!S) 



9. Enthusiasm (E) 



147 



Scale Value 



Composite 

J L 



10. Initiative (l). 



Scale Value 



U. Persistence and Drive (PD) 



Composite ^ 
Scale Value 



Composite 

f ) 



12. Flexibility (F) 



Scale Value 



13. Consideration (C) 



i 



M5 



